-- Logs begin at Wed 2021-02-17 02:39:57 UTC, end at Wed 2021-02-17 03:45:24 UTC. -- Feb 17 03:17:10.230107 dv-cinder-759961-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 17 03:17:10.237750 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 17 03:17:10.239743 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Feb 17 03:17:10 2021] *** Feb 17 03:17:10.239743 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 17 03:17:10.239743 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 17 03:17:10.239743 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: nodename: dv-cinder-759961-4-iscsi Feb 17 03:17:10.239743 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: machine: x86_64 Feb 17 03:17:10.239743 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: clock source: unix Feb 17 03:17:10.239743 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: pcre jit disabled Feb 17 03:17:10.239743 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: detected number of CPU cores: 4 Feb 17 03:17:10.239743 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: current working directory: / Feb 17 03:17:10.239743 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: detected binary path: /usr/bin/uwsgi-core Feb 17 03:17:10.239743 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: dropping root privileges as early as possible Feb 17 03:17:10.240674 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: your processes number limit is 47843 Feb 17 03:17:10.240674 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: your memory page size is 4096 bytes Feb 17 03:17:10.240674 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: detected max file descriptor number: 2048 Feb 17 03:17:10.240674 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: lock engine: pthread robust mutexes Feb 17 03:17:10.240674 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: thunder lock: enabled Feb 17 03:17:10.240674 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 17 03:17:10.240674 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: dropping root privileges after socket binding Feb 17 03:17:10.240674 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 17 03:17:10.284745 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: Python main interpreter initialized at 0x562869a129c0 Feb 17 03:17:10.284745 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: dropping root privileges after plugin initialization Feb 17 03:17:10.284745 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: python threads support enabled Feb 17 03:17:10.284745 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: your server socket listen backlog is limited to 100 connections Feb 17 03:17:10.284745 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: your mercy for graceful operations on workers is 90 seconds Feb 17 03:17:10.285202 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: mapped 402621 bytes (393 KB) for 2 cores Feb 17 03:17:10.285202 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: *** Operational MODE: preforking *** Feb 17 03:17:10.285407 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: dropping root privileges after application loading Feb 17 03:17:10.285407 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: *** uWSGI is running in multiple interpreter mode *** Feb 17 03:17:10.285407 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: spawned uWSGI master process (pid: 83309) Feb 17 03:17:10.285563 dv-cinder-759961-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 17 03:17:10.285930 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: spawned uWSGI worker 1 (pid: 83310, cores: 1) Feb 17 03:17:10.286588 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: spawned uWSGI worker 2 (pid: 83311, cores: 1) Feb 17 03:17:10.286588 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 17 03:17:14.689001 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 03:17:14.689544 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 03:17:14.690279 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 03:17:14.690588 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 03:17:14.690818 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 03:17:14.691247 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 03:17:14.691565 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 03:17:14.692032 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.692187 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 03:17:14.692379 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.692566 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 03:17:14.692749 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.692861 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 03:17:14.693108 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.693285 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.693483 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.693655 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.693829 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.694020 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.694183 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.694384 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.694543 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.694762 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.694913 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.695111 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.695218 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.695470 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.695615 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.695878 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.695985 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759961-4-iscsi {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.696250 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.696356 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.696546 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.696652 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.696902 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.696994 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.697256 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.697412 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759961-4-iscsi {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.697596 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.697738 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.697934 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.698080 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.698277 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.698399 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.698632 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.698881 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.699001 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.699226 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.699333 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.699592 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.699695 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.699944 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.700264 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.700382 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.700614 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.700716 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.700958 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.701054 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.701306 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.701414 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.701645 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.701742 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.702008 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.702124 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.702350 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.702462 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.702715 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759961-4-iscsi {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.702817 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.703054 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.703148 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.703397 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.703501 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.703771 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.703867 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.704141 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759961-4-iscsi {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.704297 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.704492 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.704641 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.704843 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.704992 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.705195 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.705345 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.705561 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.705710 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.705908 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.706079 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.706281 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.706438 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.706644 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.706801 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.707003 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.707152 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.707352 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.707549 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.707712 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.707855 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.707996 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.708136 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.708359 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.708518 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.708672 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.708816 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.709018 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.709133 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.709611 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.709716 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.709894 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.709999 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.710238 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.710342 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.710602 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.710701 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.710944 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.711042 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.711774 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.711885 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.712110 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.712221 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.712391 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.712579 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.712761 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.712922 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.713131 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.713283 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.713428 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.713570 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.713721 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.713865 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.714012 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.714155 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.714347 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.714510 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.714700 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.714867 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.715047 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.715197 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.715381 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.715628 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.715778 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.715927 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.716069 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.716210 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.716404 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.716563 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.716748 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.716905 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.717064 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.717205 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.717418 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.717580 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.717767 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.717924 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.718123 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.718274 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.718424 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.718572 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.718791 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.718951 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.719158 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.719278 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.719492 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.719627 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.719861 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.719961 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.720216 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.720314 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.720558 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.720663 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.720899 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.721002 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.721233 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.721336 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.721590 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.721688 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.721935 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.722031 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.722270 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.722375 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.722556 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.722700 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.722897 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.723056 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.723236 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.723396 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.723611 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.723781 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.723924 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.724064 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.724212 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.724364 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.724507 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.724647 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.724856 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.725007 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.725198 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.725356 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.725499 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.725640 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.725848 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.726005 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.726148 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.726301 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.726489 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.726639 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.726824 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.727588 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.727750 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.727894 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.728041 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.728182 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.728323 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.728474 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.728670 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.728828 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.729015 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.729165 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.729394 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.729543 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.729693 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.729836 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.729976 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.730117 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.730258 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.730407 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.730621 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.730780 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.730962 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.731111 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.731297 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.731453 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.731636 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.731782 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.731993 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.732143 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.732330 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.732493 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.732664 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.732886 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.733034 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.733180 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.733321 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.733470 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.733612 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.733754 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.733952 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.734102 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.734291 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.734448 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.734635 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.734800 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.734944 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.735100 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.735315 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.735472 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.735664 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.735823 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.735968 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.736115 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.736265 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.736407 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.736547 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.736686 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.736836 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.736978 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.737166 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.737317 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.737502 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.737658 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.737849 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.738005 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.738192 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.738342 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.738528 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.738678 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.738826 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.738978 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.739182 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.739332 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.739581 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.739731 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.739883 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.740028 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.740176 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.740319 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.740466 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.740606 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.740833 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:17:14.740993 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.741208 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.741365 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.741581 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.741731 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.741942 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.742101 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.742291 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.742441 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.742666 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.742826 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.743060 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.743219 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.743371 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.743541 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.743699 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.743842 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.744034 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.744187 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.744386 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.744542 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.744729 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.744879 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.745076 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.745234 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.745418 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.745579 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.745770 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.745928 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.746083 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.746233 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.746442 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.746623 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.746783 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.746931 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.747079 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.747226 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.747437 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.747643 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.747812 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.747969 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.748118 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.748264 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.748482 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.748639 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.748836 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.748992 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.749177 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.749332 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.749522 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.749766 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.749929 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.750077 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.750233 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.750381 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.750530 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.750688 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.750837 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.750984 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.751172 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.751329 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.751535 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.751711 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.751899 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.752069 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.752220 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.752382 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.752532 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.752679 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.752885 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.753059 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.753288 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.753442 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.753590 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.753738 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.753892 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.754041 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.754204 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.754352 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.754511 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.754666 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.754814 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.754967 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.755170 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.755327 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.755481 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.755689 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.755839 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.755994 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.756149 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.756306 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.756517 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.756684 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.756834 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.756989 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.757138 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.757284 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.757486 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.757648 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.757835 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.757998 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.758163 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.758315 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.758514 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.758682 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.758844 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.759000 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.759149 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.759301 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.759497 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.759752 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.759976 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.760141 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.760290 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.760437 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.760584 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.760738 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.760887 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.761049 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.761198 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.761344 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.761490 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.761637 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.761792 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.761942 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.762088 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.762242 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.762390 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.762545 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.762740 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.762903 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.763105 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.763284 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.763437 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.763628 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.763789 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.763939 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.764136 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.764294 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.764492 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.764647 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.764813 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.764962 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.765148 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.765304 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.765489 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.765652 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.765801 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.765948 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.766143 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.766301 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.766460 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.766619 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.766768 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.766930 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.767085 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.767240 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.767388 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.767588 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.767752 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.767901 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.768048 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.768196 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.768344 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.768530 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.768679 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.768844 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.769005 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.769152 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.769307 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.769469 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.769618 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.769771 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.769919 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.770154 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.770322 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.770472 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.770619 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.770767 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.770921 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.771082 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.771240 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.771390 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.771627 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.771783 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.771931 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.772078 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.772234 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.772388 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.772537 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.772684 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.772893 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.773056 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.773221 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.773370 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.773558 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.774204 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.774410 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.774567 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.774723 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.774871 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.775144 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.775308 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.775459 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.775662 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.775822 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.775970 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.776118 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.776271 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.776419 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.776630 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.776781 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.776928 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.777075 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.777222 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.777375 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.777531 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.777681 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.777846 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.778034 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.778191 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.778340 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.778499 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.778690 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.778853 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.779007 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.779158 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.779314 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.779462 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.779653 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.779803 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.780004 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.780185 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.780419 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.780579 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.780735 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.780884 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.781031 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.781177 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.781332 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.781486 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.781635 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.781782 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.781938 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.782095 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.782250 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.782397 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.782550 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.782697 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.782895 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.783058 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.783258 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.783415 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.783655 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.783810 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.783960 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.784172 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.784334 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.784483 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.784630 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.784777 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.784925 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.785082 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.785231 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.785378 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.785568 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.785724 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.785872 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.786027 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.786215 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.786380 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.786529 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.786676 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.786891 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.787056 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.787207 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.787360 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.787545 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.787702 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.787902 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.788069 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.788220 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.788367 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.788574 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.788731 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.788887 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.789041 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.789241 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.789966 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.790148 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.790299 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.790544 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.790699 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.790848 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.790996 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.791152 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.791301 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.791456 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.791633 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.791783 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.791930 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.792087 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.792236 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.792432 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.792595 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.792744 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.792891 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.793089 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.793264 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.793415 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.793562 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.793762 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.794107 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.794263 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.794419 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.794568 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.794782 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.794938 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.795140 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.795460 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.795710 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.795871 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.796025 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.796174 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.796322 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.796517 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.796682 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.796872 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.797028 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.797220 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.797376 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.797571 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.797728 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.797913 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.798078 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.798232 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.798381 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.798537 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.798687 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.798887 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.799043 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.799191 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.799339 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.799545 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.799707 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.799904 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.800069 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.800219 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.800375 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.800549 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.800772 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.800926 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.801074 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.801228 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.801383 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.801540 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.801688 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.801836 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.801983 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.802140 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.802295 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.802449 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.802597 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.802745 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.802893 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.803085 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.803249 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.803398 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.803568 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.803721 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.803870 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.804063 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.804239 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.804448 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.804604 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.804759 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.804907 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.805092 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.805250 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.805439 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.805595 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.805827 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.805985 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.806142 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.806291 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.806488 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.806645 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.806854 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.807012 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.807168 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.807317 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.807572 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.807734 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.807882 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.808030 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.808189 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.808338 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.808486 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.808647 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.808797 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.808943 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.809143 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.809300 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.809488 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.809644 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.809792 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.809938 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.810132 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.810291 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.810445 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.810599 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.810787 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.811017 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.811171 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.811320 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.811468 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.811653 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.811802 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.811961 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.812110 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.812259 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.812414 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.812562 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.812718 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.812876 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.813025 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.813172 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.813321 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.813474 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.813666 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.813834 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.813984 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.814130 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.814320 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.814477 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.814625 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.814791 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.814940 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.815087 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.815295 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.815454 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.815712 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.815870 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.816020 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.816168 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.816317 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.816466 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.816625 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.816780 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.816937 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.817091 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.817245 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.817394 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.817549 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.817697 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.817883 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.818045 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.818195 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.818343 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.818502 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.818652 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.818843 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.819008 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.819157 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.819304 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.819497 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.819729 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.819878 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.820026 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.820172 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.820341 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.820500 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.820678 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.820830 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.821000 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.821236 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.821398 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.821547 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.821696 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.821844 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.821997 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.822151 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.822307 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.822462 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.822611 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.822759 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.822907 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.823159 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.823339 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.823489 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.823682 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.823832 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.823980 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.824138 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.824292 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.824494 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.824650 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.824804 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.824953 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.825150 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.825307 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.825464 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.825618 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.825813 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.825976 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.826133 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.826281 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.826469 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.826625 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.826826 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.826982 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.827139 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.827288 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.827486 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.827684 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.827842 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.827991 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.828147 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.828296 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.828488 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.828644 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.828835 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.829005 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.829156 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.829304 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.829501 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.829657 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.829813 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.829968 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.830156 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.830312 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.830498 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.830660 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.830816 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.830973 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.831121 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.831361 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.831588 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.831753 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.831924 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.832080 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.832230 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.832378 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.832525 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.832672 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.832827 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.832974 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.833121 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.833270 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.833422 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.833570 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.833725 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.833892 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.834040 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.834187 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.834632 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.834789 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.834945 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.835093 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.835289 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.835452 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.835652 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.835809 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.835966 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.836115 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.836944 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.837131 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.837281 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.837436 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.837593 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.837742 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.837896 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.838045 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.838242 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.838407 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.838595 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.838751 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.838951 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.839138 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.839290 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.839445 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.839647 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.839775 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.840001 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.840104 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.840339 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.840450 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.840686 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.840792 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.841051 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.841149 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.841390 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.841501 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.841724 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.841822 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.842057 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.842155 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.842415 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.842519 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.842748 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.842846 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.843080 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.843178 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.843420 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.843564 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.843815 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.843914 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.844165 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.844265 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.844524 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.844624 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.844972 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.845072 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.845320 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.845418 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.845655 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.845759 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.846021 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.846120 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.846387 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.846492 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.846728 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.846828 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.847077 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.847176 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.847424 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.847609 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.847810 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.847908 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.848156 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.848274 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.848498 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.848604 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.848839 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.848950 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.849172 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.849284 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.849541 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.849660 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.849879 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.849979 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.850226 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.850326 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.850562 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.850671 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.850929 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.851027 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.851294 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.851392 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.851667 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.851771 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.852631 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.852749 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.853001 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.853099 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.853345 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.853444 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.853692 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.853789 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.854038 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.854136 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.854379 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.854478 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.854719 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.854824 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.855077 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.855175 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.855412 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.855540 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.855776 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.855885 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.856116 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.856222 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.856462 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.856561 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.856798 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.856897 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.857130 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.857255 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.857474 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.857572 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.857808 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.857904 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.858143 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.858248 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.858485 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.858583 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.858848 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.858934 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.859181 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.859287 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.859531 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.859653 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.859900 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.860008 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.860240 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.860347 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.860583 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.860680 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.860921 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.861018 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.861255 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.861352 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.861607 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.861719 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.861952 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.862051 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.862295 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.862399 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.862637 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.862736 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.863002 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.863101 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.863342 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.863440 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.863727 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.863829 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.864085 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.864183 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.864441 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.864540 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.864782 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.864886 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.865141 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.865246 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.865485 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.865589 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.865825 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.865929 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.866172 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.866277 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.866513 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.866611 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.866848 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.866973 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.867183 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.867287 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.867541 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.867665 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.867891 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.867990 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.868226 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.868326 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.868561 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.868666 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.868901 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.869000 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.869240 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.869344 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.869572 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.869685 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.869913 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.870019 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.870245 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.870351 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.870585 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.870684 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.870922 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.871027 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.871262 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.871362 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.871644 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.871746 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.871984 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.872083 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.872325 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.872423 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.872684 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.872791 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.873025 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.873125 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.873371 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.873478 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.873730 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.873829 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.874078 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.874183 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.874433 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.874532 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.874772 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.874876 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.875143 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.875270 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.875449 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.875601 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.875827 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.875927 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.876174 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.876273 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.876521 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.876621 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.876865 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.876963 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.877209 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.877308 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.877555 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.877654 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.877893 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.878129 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.878228 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.878495 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.878601 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.878869 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.878969 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.879217 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.879446 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.879585 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.879843 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.879942 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.880222 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.880321 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.880576 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.880686 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.880921 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.881019 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.881259 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.881360 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.881604 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.881712 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.881946 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.882050 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.882295 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.882394 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.882644 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.882743 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.882991 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.883139 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.883364 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.883463 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.883759 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.883860 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.884103 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.884202 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.884455 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.884553 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.884810 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.884910 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.885170 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.885268 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.885527 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.885633 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.885860 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.885959 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.886218 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.886316 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.886573 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.886679 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.886927 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.887025 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.887268 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.887373 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.887638 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.887750 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.887989 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.888088 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.888340 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.888438 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.888686 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.888785 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.889030 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.889130 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.889372 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.889471 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.889721 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.889820 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.890069 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.890183 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.890416 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.890523 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.890766 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.890864 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.891109 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.891213 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.891459 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.891614 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.891852 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.891952 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.892203 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.892436 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.892534 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.892785 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.892889 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.893156 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.893260 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.893526 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.893772 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.893891 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.894126 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.894224 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.894498 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.894601 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.894859 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.894963 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.895200 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.895299 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.895570 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.895672 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.895923 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.896035 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.896262 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.896361 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.896594 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.896692 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.896925 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.897024 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.897263 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.897365 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.897602 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.897701 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.897943 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.898048 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.898281 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.898381 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.898619 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.899412 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.899537 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.899845 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.899945 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.900193 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.900301 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.900555 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.900800 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.900899 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.901196 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.901295 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.901552 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.901658 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.901910 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.902008 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.902254 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.902352 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.902594 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.902699 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.902929 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.903026 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.903269 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.903367 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.903641 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.903745 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.903974 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.904073 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.904322 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.904420 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.904660 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.904759 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.904992 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.905096 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.905331 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.905430 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.905670 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.905773 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.906007 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.906105 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.906347 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.906445 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.906684 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.906784 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.907015 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.907114 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.907354 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.907452 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.907724 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.907825 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.908057 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.908155 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.908390 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.908497 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.908733 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.908832 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.909066 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.909164 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.909397 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.909552 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.909732 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.909832 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.910065 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.910207 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.910405 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.910512 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.910738 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.910844 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.911076 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.911174 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.911407 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.911530 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.911775 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.911875 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.912113 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.912212 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.912452 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.912558 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.912783 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.912888 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.913125 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.913224 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.913466 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.913569 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.913806 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.913910 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.914147 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.914245 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.915062 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.915168 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.915409 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.915539 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.915786 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.916042 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.916320 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.916423 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.916518 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.916753 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.916863 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.917136 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.917403 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.917503 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.917816 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.917926 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.918143 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.918253 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.918479 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.918578 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.918840 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.918938 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.919190 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.919296 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.919566 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.919671 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.919888 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.919986 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.920231 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.920341 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.920573 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.920671 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.920913 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.921020 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.921254 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.921361 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.921593 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.921692 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.921930 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.922029 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.922270 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.922369 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.922610 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.922709 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.922956 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.923054 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.923301 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.923408 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.923674 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.923777 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.924020 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.924120 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.924367 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.924469 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.924713 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.924812 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.925057 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.925203 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.925394 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.925494 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.925739 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.925837 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.926085 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.926195 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.926429 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.926528 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.926765 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.926865 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.927117 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.927230 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.927489 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.927655 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.927862 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.927961 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.928204 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.928316 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.928552 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.928655 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.928923 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.929021 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.929302 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.929411 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.929660 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.929758 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.930030 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.930137 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.930368 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.930476 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.930708 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.930815 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.931050 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.931154 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.931397 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.931497 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.931792 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.931893 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.932138 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.932237 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.932481 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.932581 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.932828 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.932928 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.933188 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.933295 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.933547 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.933646 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.933895 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.934001 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.934236 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.934341 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.934583 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.934683 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.934930 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.935028 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.935277 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.935387 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.935648 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.935767 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.935997 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.936108 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.936338 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.936446 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.936688 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.936788 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.937028 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.937127 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.937377 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.937487 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.937713 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.937812 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.938064 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.938169 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.938402 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.938501 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.938749 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.938847 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.939121 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.939225 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.939432 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.939574 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.939806 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.939917 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.940148 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.940248 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.940511 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.940611 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.940855 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.940954 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.941212 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.941311 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.941552 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.941660 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.941903 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.942002 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.942243 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.942350 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.942607 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.942706 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.942946 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.943045 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.943294 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.943402 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.943659 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.944346 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.944451 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.944699 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.944886 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.945131 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.945392 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.946355 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.946740 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.946842 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.947115 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.947222 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.947463 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.947590 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.947847 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.947946 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.948208 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.948309 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.948576 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.948675 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.948920 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.949020 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.949271 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.949371 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.949633 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.949732 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.949981 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.950088 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.950335 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.950443 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.950683 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.950795 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.951034 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.951142 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.951380 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.951479 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.951760 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.951861 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.952104 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.952217 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.952457 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.952561 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.952816 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.952922 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.953172 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.953279 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.953541 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.953640 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.953890 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.953989 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.954250 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.954350 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.954618 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.954717 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.954889 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 03:17:14.954994 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.955331 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.955763 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.956143 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:17:14.956420 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83310) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 03:17:15.069776 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_db.sqlalchemy.engines [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83311) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:17:15.070430 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_db.sqlalchemy.engines [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83310) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:17:15.329097 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.context [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b064fdc-543f-4d05-b0d7-96b33fa238fb(cell1) {{(pid=83310) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 03:17:15.332291 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.context [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b064fdc-543f-4d05-b0d7-96b33fa238fb(cell1) {{(pid=83311) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 03:17:15.334801 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83310) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:17:15.337197 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=83310) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:17:15.338061 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83310) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:17:15.338502 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:17:15.340197 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83310) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:17:15.340374 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:17:15.341233 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:17:15.343323 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:17:15.361290 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_db.sqlalchemy.engines [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83310) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:17:15.371110 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_db.sqlalchemy.engines [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83311) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:17:15.372060 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_db.sqlalchemy.engines [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83311) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:17:15.376377 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_db.sqlalchemy.engines [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83310) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:17:15.401887 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_db.sqlalchemy.engines [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83310) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:17:15.404337 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_db.sqlalchemy.engines [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83311) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:17:15.499048 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:17:15.499048 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: from cryptography.utils import int_from_bytes Feb 17 03:17:15.499323 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:17:15.499323 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: from cryptography.utils import int_from_bytes Feb 17 03:17:15.499490 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:17:15.499490 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: from cryptography.utils import int_from_bytes Feb 17 03:17:15.499761 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:17:15.499761 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: from cryptography.utils import int_from_bytes Feb 17 03:17:15.574891 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Loading Gnome Feb 17 03:17:15.577453 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Loading Gnome Feb 17 03:17:15.596273 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Loading Google Feb 17 03:17:15.598169 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Loading Google Feb 17 03:17:15.599433 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Loading Windows (alt) Feb 17 03:17:15.601536 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Loading Windows (alt) Feb 17 03:17:15.604633 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Loading file Feb 17 03:17:15.605720 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Loading keyczar Feb 17 03:17:15.606167 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Loading multi Feb 17 03:17:15.606565 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Loading file Feb 17 03:17:15.607008 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Loading pyfs Feb 17 03:17:15.607700 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Loading keyczar Feb 17 03:17:15.608152 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Loading multi Feb 17 03:17:15.609000 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO keyring.backend [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Loading pyfs Feb 17 03:17:15.887955 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: WARNING keystonemiddleware.auth_token [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:17:15.890173 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: WARNING keystonemiddleware.auth_token [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:17:15.895054 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: WARNING keystonemiddleware.auth_token [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:17:15.897442 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: WARNING keystonemiddleware.auth_token [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:17:16.228405 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: WARNING keystonemiddleware.auth_token [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:17:16.230664 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: WARNING keystonemiddleware.auth_token [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:17:16.234069 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: WARNING keystonemiddleware.auth_token [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:17:16.236476 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: WARNING keystonemiddleware.auth_token [None req-7c752862-5ddd-47c6-b461-036ddc62cbc1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:17:16.239410 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562869a129c0 pid: 83310 (default app) Feb 17 03:17:16.241755 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562869a129c0 pid: 83311 (default app) Feb 17 03:17:16.242002 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:17:16.243788 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-28a35c75-3923-46ce-96da-62dfc4081b0c None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002387 Feb 17 03:17:16.244216 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 779 bytes} [Wed Feb 17 03:17:16 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:18:41.169830 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-a2fea6f2-955c-4210-adf5-7aed9cf73688 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:18:41.194163 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-a2fea6f2-955c-4210-adf5-7aed9cf73688 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.493761 Feb 17 03:18:41.194766 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 1/2] 10.222.0.46 () {58 vars in 1150 bytes} [Wed Feb 17 03:18:40 2021] GET /compute/v2.1/flavors/detail => generated 15 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:18:44.040930 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-3818c966-30ea-4b92-af3a-aad13232c6ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:18:44.065552 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:18:44.065552 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: warnings.warn(msg) Feb 17 03:18:44.092647 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-3818c966-30ea-4b92-af3a-aad13232c6ea admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.393301 Feb 17 03:18:44.093268 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 2/3] 10.222.0.46 () {62 vars in 1183 bytes} [Wed Feb 17 03:18:43 2021] POST /compute/v2.1/flavors => generated 367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:18:44.105098 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-3f539b64-db33-402c-8397-2511f9e6065e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:18:44.107246 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:18:44.107246 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: warnings.warn(msg) Feb 17 03:18:44.143460 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-3f539b64-db33-402c-8397-2511f9e6065e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.043069 Feb 17 03:18:44.144087 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 2/4] 10.222.0.46 () {62 vars in 1236 bytes} [Wed Feb 17 03:18:44 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:18:44.154785 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-fe7ea908-ec9d-4aa3-a903-b8bb1e99b07f admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:18:44.172321 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-fe7ea908-ec9d-4aa3-a903-b8bb1e99b07f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.022090 Feb 17 03:18:44.172867 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 3/5] 10.222.0.46 () {58 vars in 1183 bytes} [Wed Feb 17 03:18:44 2021] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:18:46.726825 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-1ac35e21-7ba7-49d1-bb75-c740ed6f2ceb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:18:46.750409 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:18:46.750409 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: warnings.warn(msg) Feb 17 03:18:46.771709 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-1ac35e21-7ba7-49d1-bb75-c740ed6f2ceb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.098248 Feb 17 03:18:46.772315 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 3/6] 10.222.0.46 () {62 vars in 1183 bytes} [Wed Feb 17 03:18:46 2021] POST /compute/v2.1/flavors => generated 364 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:18:46.783171 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-4aab7662-a139-48ae-ad5c-318564d91a9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:18:46.784840 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:18:46.784840 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: warnings.warn(msg) Feb 17 03:18:46.821520 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-4aab7662-a139-48ae-ad5c-318564d91a9c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.042227 Feb 17 03:18:46.822052 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 4/7] 10.222.0.46 () {62 vars in 1236 bytes} [Wed Feb 17 03:18:46 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:18:46.831989 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-9a31fc06-b2fe-41e0-b944-8a80a197a376 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:18:46.847791 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-9a31fc06-b2fe-41e0-b944-8a80a197a376 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019643 Feb 17 03:18:46.848342 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1183 bytes} [Wed Feb 17 03:18:46 2021] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:18:49.382706 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-1ad36227-ce99-4f96-95d4-06b5b3c71f9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:18:49.404513 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-1ad36227-ce99-4f96-95d4-06b5b3c71f9d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.075516 Feb 17 03:18:49.405106 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 5/9] 10.222.0.46 () {62 vars in 1183 bytes} [Wed Feb 17 03:18:49 2021] POST /compute/v2.1/flavors => generated 364 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:18:49.415950 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-092b2514-3ac2-4e00-a0b5-a965fe623d05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:18:49.451292 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-092b2514-3ac2-4e00-a0b5-a965fe623d05 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039293 Feb 17 03:18:49.451894 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 5/10] 10.222.0.46 () {62 vars in 1236 bytes} [Wed Feb 17 03:18:49 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:18:49.462092 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-09ee2223-009e-492b-83e0-09b65e0bc836 admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:18:49.477654 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-09ee2223-009e-492b-83e0-09b65e0bc836 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019814 Feb 17 03:18:49.478209 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 6/11] 10.222.0.46 () {58 vars in 1183 bytes} [Wed Feb 17 03:18:49 2021] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:18:52.049604 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-3c964a4f-fce2-4201-8917-be610191c4a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:18:52.071255 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-3c964a4f-fce2-4201-8917-be610191c4a8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.075061 Feb 17 03:18:52.071895 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 6/12] 10.222.0.46 () {62 vars in 1183 bytes} [Wed Feb 17 03:18:51 2021] POST /compute/v2.1/flavors => generated 364 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:18:52.083355 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-97c3760e-d705-4f4a-8720-9dcf3c3317ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:18:52.118203 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-97c3760e-d705-4f4a-8720-9dcf3c3317ec admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.038723 Feb 17 03:18:52.118812 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 7/13] 10.222.0.46 () {62 vars in 1236 bytes} [Wed Feb 17 03:18:52 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:18:52.129277 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-4993505e-63da-4363-85d9-1d0818ee7216 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:18:52.146374 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-4993505e-63da-4363-85d9-1d0818ee7216 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.021003 Feb 17 03:18:52.146936 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 7/14] 10.222.0.46 () {58 vars in 1183 bytes} [Wed Feb 17 03:18:52 2021] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:18:54.684164 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-ffb3d4bb-a0e2-48f9-85c9-7a8b5c5ad6df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:18:54.707914 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-ffb3d4bb-a0e2-48f9-85c9-7a8b5c5ad6df admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.077221 Feb 17 03:18:54.708517 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 8/15] 10.222.0.46 () {62 vars in 1183 bytes} [Wed Feb 17 03:18:54 2021] POST /compute/v2.1/flavors => generated 364 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:18:54.719631 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-9267cb2f-7360-480d-9816-8901baddf63b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:18:54.754952 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-9267cb2f-7360-480d-9816-8901baddf63b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039239 Feb 17 03:18:54.755489 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 8/16] 10.222.0.46 () {62 vars in 1236 bytes} [Wed Feb 17 03:18:54 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:18:54.765241 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-8b06685c-142e-4095-b398-1c7dbe2e4c15 admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:18:54.780451 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-8b06685c-142e-4095-b398-1c7dbe2e4c15 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.018967 Feb 17 03:18:54.781006 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 9/17] 10.222.0.46 () {58 vars in 1183 bytes} [Wed Feb 17 03:18:54 2021] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:18:57.333816 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-0e58fba5-9acc-43a8-bf15-fdd6cf5ff1ed admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:18:57.354500 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-0e58fba5-9acc-43a8-bf15-fdd6cf5ff1ed admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.073399 Feb 17 03:18:57.355070 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 9/18] 10.222.0.46 () {58 vars in 1150 bytes} [Wed Feb 17 03:18:57 2021] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:18:59.895245 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-8ee5f090-e442-4f79-846b-f5926ec77b7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:18:59.916773 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-8ee5f090-e442-4f79-846b-f5926ec77b7b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.074950 Feb 17 03:18:59.917363 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 10/19] 10.222.0.46 () {62 vars in 1183 bytes} [Wed Feb 17 03:18:59 2021] POST /compute/v2.1/flavors => generated 362 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:18:59.928132 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-f73ceeaa-693d-4cb5-bb26-f5050ab29c01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:18:59.963497 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-f73ceeaa-693d-4cb5-bb26-f5050ab29c01 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039354 Feb 17 03:18:59.964120 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 10/20] 10.222.0.46 () {62 vars in 1233 bytes} [Wed Feb 17 03:18:59 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:18:59.973989 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-4e28c2ce-282c-4d42-ad99-81d55a57fe23 admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:18:59.989820 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-4e28c2ce-282c-4d42-ad99-81d55a57fe23 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019633 Feb 17 03:18:59.990388 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 11/21] 10.222.0.46 () {58 vars in 1180 bytes} [Wed Feb 17 03:18:59 2021] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:02.573548 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-952b6f73-f87a-4f2e-a2f0-bf9dea55743e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:02.596091 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-952b6f73-f87a-4f2e-a2f0-bf9dea55743e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.075501 Feb 17 03:19:02.596687 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 11/22] 10.222.0.46 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:02 2021] POST /compute/v2.1/flavors => generated 365 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:02.607935 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-fbde0f65-a903-454f-b64a-3f3f20a52967 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:02.642154 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-fbde0f65-a903-454f-b64a-3f3f20a52967 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.038661 Feb 17 03:19:02.642750 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 12/23] 10.222.0.46 () {62 vars in 1233 bytes} [Wed Feb 17 03:19:02 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:02.652952 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-e7808ce6-52a2-444a-903f-87d3493d5c01 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:02.668583 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-e7808ce6-52a2-444a-903f-87d3493d5c01 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019953 Feb 17 03:19:02.669133 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 12/24] 10.222.0.46 () {58 vars in 1180 bytes} [Wed Feb 17 03:19:02 2021] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:05.233187 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-41cdc2a2-4a4f-47cd-8d33-62814f4e2a85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:05.256165 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-41cdc2a2-4a4f-47cd-8d33-62814f4e2a85 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.078035 Feb 17 03:19:05.256764 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 13/25] 10.222.0.46 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:05 2021] POST /compute/v2.1/flavors => generated 366 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:05.268163 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-7554e08e-7960-4e10-8a8e-fa6d0e50cc2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:05.303183 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-7554e08e-7960-4e10-8a8e-fa6d0e50cc2d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.038984 Feb 17 03:19:05.303752 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 13/26] 10.222.0.46 () {62 vars in 1233 bytes} [Wed Feb 17 03:19:05 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:05.313744 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-29c9e471-897d-40db-8a30-6b418f62152f admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:05.329532 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-29c9e471-897d-40db-8a30-6b418f62152f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019717 Feb 17 03:19:05.330085 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 14/27] 10.222.0.46 () {58 vars in 1180 bytes} [Wed Feb 17 03:19:05 2021] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:07.870009 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-41d6ff3a-5580-43f0-9676-15be8083676e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:07.892200 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-41d6ff3a-5580-43f0-9676-15be8083676e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.077087 Feb 17 03:19:07.892795 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 14/28] 10.222.0.46 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:07 2021] POST /compute/v2.1/flavors => generated 365 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:07.903536 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-ef9d781d-a231-4cbc-a621-b3aea02208e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:07.938331 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-ef9d781d-a231-4cbc-a621-b3aea02208e9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.038770 Feb 17 03:19:07.938916 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 15/29] 10.222.0.46 () {62 vars in 1233 bytes} [Wed Feb 17 03:19:07 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:07.949109 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-047f1065-3592-4e8c-8362-331077da47d5 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:07.964740 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-047f1065-3592-4e8c-8362-331077da47d5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020022 Feb 17 03:19:07.965296 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 15/30] 10.222.0.46 () {58 vars in 1180 bytes} [Wed Feb 17 03:19:07 2021] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:10.534739 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-f76f8e12-f18e-4289-847e-416bd4117ea0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:10.557793 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-f76f8e12-f18e-4289-847e-416bd4117ea0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.077646 Feb 17 03:19:10.558388 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 16/31] 10.222.0.46 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:10 2021] POST /compute/v2.1/flavors => generated 368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:10.569048 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-69c2a0cb-3dd7-4c83-9d59-4ae64a034767 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:10.605579 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-69c2a0cb-3dd7-4c83-9d59-4ae64a034767 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.040335 Feb 17 03:19:10.606196 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 16/32] 10.222.0.46 () {62 vars in 1233 bytes} [Wed Feb 17 03:19:10 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:10.616146 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-3e21aba9-1717-4da9-b169-dd09d5719d3b admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:10.631832 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-3e21aba9-1717-4da9-b169-dd09d5719d3b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019526 Feb 17 03:19:10.632378 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 17/33] 10.222.0.46 () {58 vars in 1180 bytes} [Wed Feb 17 03:19:10 2021] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:20:20.970208 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-da82228e-152e-485c-809c-44cb7ae27d99 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:20.993866 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-da82228e-152e-485c-809c-44cb7ae27d99 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.076653 Feb 17 03:20:20.994451 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 17/34] 10.222.0.46 () {58 vars in 1150 bytes} [Wed Feb 17 03:20:20 2021] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:20:22.641434 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-3e21aba9-1717-4da9-b169-dd09d5719d3b admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:22.642505 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-3e21aba9-1717-4da9-b169-dd09d5719d3b admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Feb 17 03:20:22.642937 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 18/35] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:20:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:20:22.826761 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-e8f36f71-d5b6-4c42-bbfe-a396877d2a66 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:22.841668 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.wsgi [None req-e8f36f71-d5b6-4c42-bbfe-a396877d2a66 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 17 03:20:22.842297 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-e8f36f71-d5b6-4c42-bbfe-a396877d2a66 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:20:22.843141 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-e8f36f71-d5b6-4c42-bbfe-a396877d2a66 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.069320 Feb 17 03:20:22.843740 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 18/36] 10.222.0.46 () {60 vars in 1181 bytes} [Wed Feb 17 03:20:22 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 03:20:22.853908 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-b381a9df-a567-4cf8-b73e-42b3951b7966 admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:22.875489 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-b381a9df-a567-4cf8-b73e-42b3951b7966 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025410 Feb 17 03:20:22.876079 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 19/37] 10.222.0.46 () {60 vars in 1201 bytes} [Wed Feb 17 03:20:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:20:22.886014 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-31992e7d-c86a-42ca-8f11-a45c9da609ad admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:22.910269 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-31992e7d-c86a-42ca-8f11-a45c9da609ad admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.027871 Feb 17 03:20:22.910822 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 19/38] 10.222.0.46 () {60 vars in 1201 bytes} [Wed Feb 17 03:20:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:20:22.920727 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-9f47801f-c2a2-4e0c-ac3c-fa88c43df5bc admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:22.934620 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.wsgi [None req-9f47801f-c2a2-4e0c-ac3c-fa88c43df5bc admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 17 03:20:22.935260 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-9f47801f-c2a2-4e0c-ac3c-fa88c43df5bc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:20:22.936134 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-9f47801f-c2a2-4e0c-ac3c-fa88c43df5bc admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.019221 Feb 17 03:20:22.936677 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 20/39] 10.222.0.46 () {60 vars in 1181 bytes} [Wed Feb 17 03:20:22 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 03:20:24.480927 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-31992e7d-c86a-42ca-8f11-a45c9da609ad admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:24.482080 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-31992e7d-c86a-42ca-8f11-a45c9da609ad admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Feb 17 03:20:24.482555 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 20/40] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:20:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:20:24.662114 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-e3a000f8-fc76-4bc0-b2ac-dc545e4af598 admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:24.677093 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.wsgi [None req-e3a000f8-fc76-4bc0-b2ac-dc545e4af598 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 17 03:20:24.677706 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-e3a000f8-fc76-4bc0-b2ac-dc545e4af598 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:20:24.678535 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-e3a000f8-fc76-4bc0-b2ac-dc545e4af598 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.069745 Feb 17 03:20:24.679072 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1181 bytes} [Wed Feb 17 03:20:24 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 03:20:24.689793 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-d838a664-f640-4d39-855c-8a47c7869094 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:24.711560 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-d838a664-f640-4d39-855c-8a47c7869094 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025534 Feb 17 03:20:24.712368 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 21/42] 10.222.0.46 () {60 vars in 1201 bytes} [Wed Feb 17 03:20:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:20:24.722528 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-8c3fc9fb-b43b-49b6-850e-2f6e4963fedc admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:24.743985 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-8c3fc9fb-b43b-49b6-850e-2f6e4963fedc admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025321 Feb 17 03:20:24.744586 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 22/43] 10.222.0.46 () {60 vars in 1201 bytes} [Wed Feb 17 03:20:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:20:24.755345 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-2d2e3133-c5c4-4ca2-a1fb-ea517033f742 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:24.768713 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.wsgi [None req-2d2e3133-c5c4-4ca2-a1fb-ea517033f742 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 17 03:20:24.769323 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-2d2e3133-c5c4-4ca2-a1fb-ea517033f742 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:20:24.770146 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-2d2e3133-c5c4-4ca2-a1fb-ea517033f742 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.018724 Feb 17 03:20:24.770683 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 22/44] 10.222.0.46 () {60 vars in 1181 bytes} [Wed Feb 17 03:20:24 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 03:20:26.323786 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-8c3fc9fb-b43b-49b6-850e-2f6e4963fedc admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:26.324853 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-8c3fc9fb-b43b-49b6-850e-2f6e4963fedc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Feb 17 03:20:26.325955 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 23/45] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:20:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:20:26.504536 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-61142436-9cce-4eaf-b4fd-0beb25282847 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:26.517274 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.wsgi [None req-61142436-9cce-4eaf-b4fd-0beb25282847 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 17 03:20:26.517910 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-61142436-9cce-4eaf-b4fd-0beb25282847 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:20:26.518723 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-61142436-9cce-4eaf-b4fd-0beb25282847 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.067278 Feb 17 03:20:26.519261 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1184 bytes} [Wed Feb 17 03:20:26 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 03:20:26.529332 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-20792b12-df5a-4406-9461-dc398a97d2df admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:26.551072 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-20792b12-df5a-4406-9461-dc398a97d2df admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025523 Feb 17 03:20:26.551678 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 24/47] 10.222.0.46 () {60 vars in 1201 bytes} [Wed Feb 17 03:20:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:20:26.562518 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:26.583637 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025484 Feb 17 03:20:26.584205 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 24/48] 10.222.0.46 () {60 vars in 1201 bytes} [Wed Feb 17 03:20:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:20:26.594241 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-f212066b-8ae0-408b-b491-cfa6aca9606d admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:26.607246 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.wsgi [None req-f212066b-8ae0-408b-b491-cfa6aca9606d admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 17 03:20:26.607881 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-f212066b-8ae0-408b-b491-cfa6aca9606d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:20:26.608698 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-f212066b-8ae0-408b-b491-cfa6aca9606d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.018261 Feb 17 03:20:26.609226 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 25/49] 10.222.0.46 () {60 vars in 1184 bytes} [Wed Feb 17 03:20:26 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 03:20:28.175715 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:28.176793 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Feb 17 03:20:28.177221 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 25/50] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:20:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:20:28.359229 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-120121e5-8b30-4a66-8629-d6060d0d4a47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:20:28.383631 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-120121e5-8b30-4a66-8629-d6060d0d4a47 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.077920 Feb 17 03:20:28.384162 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 26/51] 10.222.0.46 () {64 vars in 1226 bytes} [Wed Feb 17 03:20:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:20:29.919037 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:29.920177 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001630 Feb 17 03:20:29.920617 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 26/52] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:20:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:20:30.101808 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-71ecfb8f-fb58-43f3-aa38-be2531fb8688 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:20:30.125438 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-71ecfb8f-fb58-43f3-aa38-be2531fb8688 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.078209 Feb 17 03:20:30.125954 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 27/53] 10.222.0.46 () {64 vars in 1226 bytes} [Wed Feb 17 03:20:30 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:20:31.675456 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:31.676640 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Feb 17 03:20:31.677119 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 27/54] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:20:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:20:31.856243 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-22b690a3-2712-47d4-aa5e-ab9a28a0f73e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:20:31.880969 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-22b690a3-2712-47d4-aa5e-ab9a28a0f73e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.077064 Feb 17 03:20:31.881493 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 28/55] 10.222.0.46 () {64 vars in 1226 bytes} [Wed Feb 17 03:20:31 2021] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:20:33.439746 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:33.441089 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Feb 17 03:20:33.441522 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 28/56] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:20:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:20:33.622789 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-19a20df5-f079-46a4-8229-38071732104d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:20:33.646312 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-19a20df5-f079-46a4-8229-38071732104d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.076848 Feb 17 03:20:33.646833 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 29/57] 10.222.0.46 () {64 vars in 1226 bytes} [Wed Feb 17 03:20:33 2021] POST /compute/v2.1/flavors => generated 409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:20:35.194738 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:35.195830 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Feb 17 03:20:35.196266 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 29/58] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:20:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:20:35.376409 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-e8350df9-4fd2-4cba-afb5-00c57fa5ff36 admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:20:35.406817 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-e8350df9-4fd2-4cba-afb5-00c57fa5ff36 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.083795 Feb 17 03:20:35.407388 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 30/59] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Feb 17 03:20:35 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:21:25.372144 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:25.373211 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-8653e10b-e2c1-4ffd-a7e4-3e75b7452730 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 Feb 17 03:21:25.373652 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 30/60] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:21:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:21:25.554664 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-fda6acc6-4473-4b46-9b36-6c6ee9447ca7 admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:25.583678 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-fda6acc6-4473-4b46-9b36-6c6ee9447ca7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.082578 Feb 17 03:21:25.584426 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 31/61] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Feb 17 03:21:25 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:22:49.204518 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-d869512f-38c7-46bd-997e-17975cbb4d2d tempest-verify_tempest_config-691294121 tempest-verify_tempest_config-691294121-project] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:22:49.206505 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-d869512f-38c7-46bd-997e-17975cbb4d2d tempest-verify_tempest_config-691294121 tempest-verify_tempest_config-691294121-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.120150 Feb 17 03:22:49.207065 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 31/62] 10.222.0.46 () {58 vars in 1124 bytes} [Wed Feb 17 03:22:49 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:24:18.217043 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-fda6acc6-4473-4b46-9b36-6c6ee9447ca7 admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:24:18.218163 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-fda6acc6-4473-4b46-9b36-6c6ee9447ca7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001892 Feb 17 03:24:18.218603 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 32/63] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:24:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:24:18.478742 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-46ac6625-27a9-4feb-b99f-90589dec75d6 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:24:18.480068 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:24:18.480068 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: warnings.warn(msg) Feb 17 03:24:18.482241 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-46ac6625-27a9-4feb-b99f-90589dec75d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:24:18.482730 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-46ac6625-27a9-4feb-b99f-90589dec75d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:24:18.483600 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-46ac6625-27a9-4feb-b99f-90589dec75d6 admin admin] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:24:18.484072 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-46ac6625-27a9-4feb-b99f-90589dec75d6 admin admin] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:24:18.518673 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-46ac6625-27a9-4feb-b99f-90589dec75d6 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.169349 Feb 17 03:24:18.519282 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 32/64] 10.222.0.46 () {60 vars in 1184 bytes} [Wed Feb 17 03:24:18 2021] GET /compute/v2.1/os-services => generated 791 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:24:20.188838 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-fda6acc6-4473-4b46-9b36-6c6ee9447ca7 admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:24:20.189904 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-fda6acc6-4473-4b46-9b36-6c6ee9447ca7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Feb 17 03:24:20.190338 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 33/65] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:24:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:24:20.374084 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-e9495c9b-074e-4f76-8e4c-20b61147f183 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:24:20.375364 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:24:20.375364 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: warnings.warn(msg) Feb 17 03:24:20.376949 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-e9495c9b-074e-4f76-8e4c-20b61147f183 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:24:20.377439 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-e9495c9b-074e-4f76-8e4c-20b61147f183 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:24:20.378285 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-e9495c9b-074e-4f76-8e4c-20b61147f183 admin admin] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:24:20.378784 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-e9495c9b-074e-4f76-8e4c-20b61147f183 admin admin] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:24:20.404507 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-e9495c9b-074e-4f76-8e4c-20b61147f183 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.083464 Feb 17 03:24:20.405076 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 33/66] 10.222.0.46 () {60 vars in 1184 bytes} [Wed Feb 17 03:24:20 2021] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:24:32.390660 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-fda6acc6-4473-4b46-9b36-6c6ee9447ca7 admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:24:32.391759 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-fda6acc6-4473-4b46-9b36-6c6ee9447ca7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Feb 17 03:24:32.392192 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 34/67] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:24:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:24:32.574157 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-c6d837dd-ebf5-4119-8336-bd5ab27f6b72 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:24:32.575404 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:24:32.575404 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: warnings.warn(msg) Feb 17 03:24:32.576992 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-c6d837dd-ebf5-4119-8336-bd5ab27f6b72 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:24:32.577480 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-c6d837dd-ebf5-4119-8336-bd5ab27f6b72 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:24:32.578317 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-c6d837dd-ebf5-4119-8336-bd5ab27f6b72 admin admin] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:24:32.578788 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-c6d837dd-ebf5-4119-8336-bd5ab27f6b72 admin admin] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:24:32.610415 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-c6d837dd-ebf5-4119-8336-bd5ab27f6b72 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.090074 Feb 17 03:24:32.610999 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 34/68] 10.222.0.46 () {60 vars in 1184 bytes} [Wed Feb 17 03:24:32 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:24:34.184762 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-fda6acc6-4473-4b46-9b36-6c6ee9447ca7 admin admin] Calling method '>' {{(pid=83310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:24:34.185835 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-fda6acc6-4473-4b46-9b36-6c6ee9447ca7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Feb 17 03:24:34.186306 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83310|app: 0|req: 35/69] 10.222.0.46 () {56 vars in 1065 bytes} [Wed Feb 17 03:24:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:24:34.369018 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG nova.api.openstack.wsgi [None req-e1218f55-7cf0-4f36-984e-25eea101dcc2 admin admin] Calling method '>' {{(pid=83311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:24:34.370327 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:24:34.370327 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: warnings.warn(msg) Feb 17 03:24:34.371917 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-e1218f55-7cf0-4f36-984e-25eea101dcc2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:24:34.372408 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-e1218f55-7cf0-4f36-984e-25eea101dcc2 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:24:34.373295 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-e1218f55-7cf0-4f36-984e-25eea101dcc2 admin admin] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:24:34.373808 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: DEBUG oslo_concurrency.lockutils [None req-e1218f55-7cf0-4f36-984e-25eea101dcc2 admin admin] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:24:34.400890 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: INFO nova.api.openstack.requestlog [None req-e1218f55-7cf0-4f36-984e-25eea101dcc2 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.085790 Feb 17 03:24:34.401409 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: [pid: 83311|app: 0|req: 35/70] 10.222.0.46 () {60 vars in 1184 bytes} [Wed Feb 17 03:24:34 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:25:32.872237 dv-cinder-759961-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 17 03:25:32.872998 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: Wed Feb 17 03:25:32 2021 - graceful shutdown triggered... Feb 17 03:25:32.873477 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: Gracefully killing worker 1 (pid: 83310)... Feb 17 03:25:32.873595 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: Gracefully killing worker 2 (pid: 83311)... Feb 17 03:25:33.874084 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: worker 1 buried after 1 seconds Feb 17 03:25:33.874084 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: worker 2 buried after 1 seconds Feb 17 03:25:33.874084 dv-cinder-759961-4-iscsi devstack@n-api.service[83309]: goodbye to uWSGI. Feb 17 03:25:33.875808 dv-cinder-759961-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 17 03:25:33.877446 dv-cinder-759961-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 17 03:25:33.885293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Feb 17 03:25:33 2021] *** Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: nodename: dv-cinder-759961-4-iscsi Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: machine: x86_64 Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: clock source: unix Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: pcre jit disabled Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: detected number of CPU cores: 4 Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: current working directory: / Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: detected binary path: /usr/bin/uwsgi-core Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: dropping root privileges as early as possible Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: your processes number limit is 47843 Feb 17 03:25:33.887308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: your memory page size is 4096 bytes Feb 17 03:25:33.888493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: detected max file descriptor number: 2048 Feb 17 03:25:33.888493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: lock engine: pthread robust mutexes Feb 17 03:25:33.888493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: thunder lock: enabled Feb 17 03:25:33.888493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 17 03:25:33.888493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: dropping root privileges after socket binding Feb 17 03:25:33.888493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 17 03:25:33.933206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Python main interpreter initialized at 0x5572281839c0 Feb 17 03:25:33.933206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: dropping root privileges after plugin initialization Feb 17 03:25:33.933206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: python threads support enabled Feb 17 03:25:33.933206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: your server socket listen backlog is limited to 100 connections Feb 17 03:25:33.933206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: your mercy for graceful operations on workers is 90 seconds Feb 17 03:25:33.933628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: mapped 402621 bytes (393 KB) for 2 cores Feb 17 03:25:33.933628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: *** Operational MODE: preforking *** Feb 17 03:25:33.933892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: dropping root privileges after application loading Feb 17 03:25:33.933892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: *** uWSGI is running in multiple interpreter mode *** Feb 17 03:25:33.933892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: spawned uWSGI master process (pid: 98182) Feb 17 03:25:33.934048 dv-cinder-759961-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 17 03:25:33.934368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: spawned uWSGI worker 1 (pid: 98183, cores: 1) Feb 17 03:25:33.943547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: spawned uWSGI worker 2 (pid: 98184, cores: 1) Feb 17 03:25:33.943547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 17 03:25:38.457436 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 03:25:38.458466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 03:25:38.459285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 03:25:38.459748 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 03:25:38.460045 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 03:25:38.460744 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.460862 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.461230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.461628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.462008 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.462365 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.462727 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.463088 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.463462 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.463793 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.464152 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.464525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759961-4-iscsi {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.464899 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.465245 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.465595 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.465960 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.466308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.466675 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.467020 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.467927 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.468307 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.468657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.469021 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.469398 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.469749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.470098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.470466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.470816 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.471191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.471562 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.471929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759961-4-iscsi {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.472294 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.472647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.473003 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.473508 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.473861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.474210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.474559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.474923 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.475269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.475775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.476147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.476515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.476879 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.477221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.477568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.477919 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.478285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.478627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.478973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.479259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.479630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.479999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.480365 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.480737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.481025 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.481310 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.481674 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.482046 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.482401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.482748 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.483094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.483440 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.483815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.484700 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.485047 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.485394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.485757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.486118 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.486486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.486833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.487197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.487676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.487964 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.488310 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.488701 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.489061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.489405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.489764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.490130 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.490475 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.490821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.491164 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.491534 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.491916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.492259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.492543 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.492771 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 03:25:38.492923 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.493066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 03:25:38.493222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.493535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.493878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.494225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.494570 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.494747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 03:25:38.494894 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.495061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 03:25:38.495218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.495372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 03:25:38.495544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.495703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.495864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.496081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.496272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.496429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.496572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.496715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.496858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.497108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.497264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.497408 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.497557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.497710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.497933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.498111 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.498263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.498413 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.498601 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.498754 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.498946 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.499114 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.499258 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.499400 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759961-4-iscsi {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.500202 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.500358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.500550 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.500702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.500896 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.501049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.501236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.501392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.502854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.503028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.503181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.503334 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.503492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.503726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.503726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.504026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.504195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.504340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.504483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.504633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.504776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.504926 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.505069 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.505213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.505361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.505511 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.505670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.505819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.505977 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.506120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.506272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.506423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.506571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.506720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.506870 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.507018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.507264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.507431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759961-4-iscsi {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.507608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.507761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.507904 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.508054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.508203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.508358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.508510 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.508664 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.508808 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.508950 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.509100 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.509242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.509384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.509527 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.509675 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.509824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.509983 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.510131 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.510279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.510428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.510576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.510718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.510868 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.511011 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.511158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.511301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.511449 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.511627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.511786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.511936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.512079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.512229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.512381 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.512538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.512681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.512848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.513066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.513214 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.513357 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.513512 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.513657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.513807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.513950 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.514091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.514240 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.514397 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.514546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.514696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.514847 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.515000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.515210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.515367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.515595 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.515757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.515907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.516057 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.516208 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.516357 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.516506 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.516655 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.516805 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.516962 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.517105 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.517269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.517486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.517644 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.517787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.517942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.518091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.518233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.518381 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.518529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.518672 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.518896 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.519057 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.519250 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.519408 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.519647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.519816 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.519970 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.520113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.520347 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.520506 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.520658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.520802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.521001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.521158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.521358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.521510 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.521717 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.521881 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.522043 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.522193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.522387 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.522545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.522752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.522911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.523081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.523304 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.523453 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.523622 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.523767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.523921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.524073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.524223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.524373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.524515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.524727 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.524891 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.525042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.525193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.525335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.525477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.525633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.525782 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.525932 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.526086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.526280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.526431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.526625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.526776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.526969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.527127 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.527308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.527474 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.527778 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.527934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.528077 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.528227 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.528389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.528539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.528690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.528839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.528988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.529135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.529285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.529435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.529586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.529738 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.529880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.530022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.530164 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.530327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.530531 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.530683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.530916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.531075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.531262 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.531431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.531613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.531765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.531952 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.532119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.532277 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.532420 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.532630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.532787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.532974 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.533132 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.533300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.533525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.533682 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.533832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.533984 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.534134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.534289 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.534438 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.534588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.534741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.534929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.535089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.535272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.535423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.535621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.535778 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.535967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.536130 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.536281 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.536426 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.536630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.536788 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.536950 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.537104 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.537247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.537390 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.537587 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.537820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.537969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.538125 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.538275 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.538418 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.538559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.538707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.538860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.539014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.539165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.539313 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.539457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.539628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.539848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.540007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.540200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.540351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.540540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.540691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.540886 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.541051 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.541202 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.541351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.541561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:25:38.541719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.541921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.542073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.542283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.542441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.542632 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.542795 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.542948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.543098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.543293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.543445 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.543750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.543911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.544057 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.544199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.544341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.544492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.544635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.544788 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.544939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.545090 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.545287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.545454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.545649 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.545809 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.546973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.547137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.547353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.547543 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.547710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.547958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.548114 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.548270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.548420 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.548582 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.548731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.548887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.549044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.549199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.549395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.549559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.549716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.549865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.550058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.550216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.550414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.550576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.550742 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.550892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.551089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.551254 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.551410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.551589 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.551867 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.552025 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.552218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.552383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.552533 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.552680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.552878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.553045 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.553232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.553396 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.553553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.553726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.553947 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.554100 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.554249 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.554404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.554560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.554722 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.554871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.555018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.555216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.555373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.555610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.555832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.555984 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.556132 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.556286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.556442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.556593 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.556751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.556901 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.557055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.557210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.557368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.557529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.557690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.557839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.558072 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.558226 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.558380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.558541 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.558698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.558977 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.559173 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.559337 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.559487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.559681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.559832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.559988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.560137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.560293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.560448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.560609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.560766 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.560914 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.561062 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.561215 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.561370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.561530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.561694 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.561845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.562013 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.562750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.562908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.563057 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.563205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.563352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.563500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.563692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.563855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.564099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.564269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.564427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.564576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.564723 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.564879 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.565035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.565184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.565337 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.565622 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.565783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.565944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.566100 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.566321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.566486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.566674 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.566839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.566988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.567136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.567361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.567588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.567753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.567920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.568086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.568313 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.568472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.568622 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.568779 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.568939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.569089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.569243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.569392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.569539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.569693 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.569854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.570003 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.570150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.570311 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.570466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.570621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.570785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.570940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.571089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.571238 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.571386 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.571585 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.571741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.571896 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.572049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.572204 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.572359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.572519 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.572669 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.572873 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.573035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.573184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.573338 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.573540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.573703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.573852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.574000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.574239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.574397 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.574558 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.574713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.574870 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.575018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.575173 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.575323 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.575480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.575698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.575855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.576010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.576159 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.576315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.576512 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.576677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.576876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.577041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.577189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.577345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.577542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.577731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.577881 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.578038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.578232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.578483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.578647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.578802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.578962 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.579111 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.579274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.579431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.579625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.579778 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.579925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.580073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.580235 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.580390 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.580549 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.580706 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.580854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.581009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.581165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.581327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.581476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.581631 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.581788 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.581936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.582095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.582243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.582429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.582586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.582773 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.582929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.583090 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.583238 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.583400 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.583586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.583750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.583907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.584067 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.584233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.584429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.584585 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.584778 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.584947 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.585097 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.585251 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.585405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.585569 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.585724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.585884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.586033 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.586181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.586381 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.586544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.586746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.586966 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.587119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.587266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.587413 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.587639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.587804 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.587969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.588129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.588279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.588427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.588662 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.588817 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.588981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.589132 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.589279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.589439 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.589587 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.589756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.589905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.590053 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.590201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.590347 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.590495 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.590650 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.590800 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.590947 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.591094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.591242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.591389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.591567 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.591730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.591885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.592034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.592187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.592343 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.592804 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.592963 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.593147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.593334 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.593564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.593728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.593883 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.594037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.594202 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.594353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.594553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.594718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.594867 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.595025 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.595181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.595329 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.595536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.595707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.595894 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.596057 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.596205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.596361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.596515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.596863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.597020 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.597225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.597388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.597576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.597732 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.597929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.598085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.598283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.598439 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.598710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.598891 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.599042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.599195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.599349 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.599498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.599684 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.599842 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.599997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.600151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.600305 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.600460 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.600610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.600765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.600922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.601071 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.601268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.601424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.601579 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.601740 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.601889 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.602044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.602198 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.602354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.602513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.602668 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.602826 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.602973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.603164 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.603320 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.603480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.603690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.603841 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.603995 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.604150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.604304 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.604464 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.604619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.604767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.604924 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.605110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.605266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.605475 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.605632 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.605818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.605975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.606129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.606277 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.606432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.606588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.606777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.606936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.607163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.607327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.607476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.607650 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.607883 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.608041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.608255 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.608423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.608573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.608728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.609479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.609641 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.609798 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.609967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.610124 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.610273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.610421 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.610574 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.610767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.610932 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.611083 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.611230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.611434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.611701 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.611870 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.612021 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.612179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.612327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.612480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.612629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.612784 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.612933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.613079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.613234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.613383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.613530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.613685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.613833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.614036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.614199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.614356 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.614504 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.614659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.614920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.615077 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.615273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.615430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.615632 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.616106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.616106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.616403 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.616561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.616710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.616865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.617015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.617162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.617317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.617473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.617621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.617776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.617931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.618079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.618232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.618381 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.618544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.618763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.618912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.619060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.619213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.619428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.619647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.619811 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.619966 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.620115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.620263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.620411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.620571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.620730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.620879 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.621033 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.621181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.621328 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.621483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.621632 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.621780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.621933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.622087 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.622236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.622391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.622540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.622702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.622857 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.623005 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.623153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.623308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.623457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.623698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.623851 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.623999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.624157 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.624314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.624463 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.625290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.625441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.625597 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.625753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.625902 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.626049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.626248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.626412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.626609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.626777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.626934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.627083 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.627271 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.627444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.627650 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.627810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.627966 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.628116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.628270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.628419 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.628574 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.628731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.628926 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.629090 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.629240 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.629394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.629609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.629780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.629930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.630085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.630283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.630440 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.630639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.630859 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.631018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.631176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.631331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.631479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.631683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.631843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.631998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.632147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.632301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.632449 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.632608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.632768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.632922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.633070 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.633273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.633435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.633595 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.633751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.633914 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.634062 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.634269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.634436 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.634586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.634734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.634936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.635098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.635255 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.635415 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.635644 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.635797 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.635955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.636113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.636327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.636485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.636633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.636781 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.636928 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.637081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.637231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.637387 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.637535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.637682 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.637872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.638043 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.638204 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.638366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.638521 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.638677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.638826 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.638973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.639128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.639314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.639477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.639667 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.639831 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.639991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.640182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.640342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.640500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.640693 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.640856 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.641046 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.641209 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.641359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.641508 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.641811 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.641967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.642161 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.642328 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.642487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.642636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.642835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.642992 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.643202 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.643366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.643558 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.643714 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.643872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.644027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.644224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.644387 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.644544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.644709 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.644858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.645005 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.645200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.645362 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.645562 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.645720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.645874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.646022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.646232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.646394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.646544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.646691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.646897 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.647059 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.647221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.647433 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.647626 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.647851 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.648164 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.648333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.648528 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.648685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.648898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.649063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.649227 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.649383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.649578 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.649740 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.649891 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.650046 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.650239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.650468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.650627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.650776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.650923 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.651077 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.651225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.651389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.651615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.651771 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.651928 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.652078 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.652237 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.652391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.652552 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.652709 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.652916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.653080 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.653294 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.653443 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.653601 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.653755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.653985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.654137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.654293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.654443 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.654598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.654754 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.654993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.655161 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.655353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.655554 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.655740 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.655907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.656066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.656217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.656375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.656525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.656685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.656835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.656990 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.657146 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.657345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.657502 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.657668 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.657825 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.658012 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.658175 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.658363 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.658520 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.658678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.658834 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.659021 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.659184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.659400 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.659589 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.659757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.659916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.660143 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.660304 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.660468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.660633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.660787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.660935 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.661459 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.661620 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.661777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.661935 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.662085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.662085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.662387 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.662674 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.662830 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.662993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.663151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.663301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.663455 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.663682 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.663843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.664003 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.664165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.664314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.664478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.664635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.664794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.664952 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.665107 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.665263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.665413 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.665560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.665722 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.665888 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.666044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.666199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.666357 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.666517 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.666680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.666837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.666986 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.667134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.667289 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.667444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.667630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.667783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.667943 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.668099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.668296 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.668454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.668625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.668783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.668933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.669081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.669276 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.669503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.669655 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.669812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.669961 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.670109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.670256 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.670413 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.670569 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.670736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.670893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.671043 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.671233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.671934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.672146 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.672310 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.672466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.672616 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.672811 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.672977 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.673134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.673283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.673440 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.673602 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.673764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.673921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.674078 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.674233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.674389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.674545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.674702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.674852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.675072 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.675236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.675401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.675576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.675745 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.675906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.676056 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.676206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.676401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.676557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.676714 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.676912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.677075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.677268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.677433 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.677598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.677763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.677952 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.678115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.678275 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.678425 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.678628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.678792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.678952 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.679101 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.679251 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.679399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.679599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.679764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.679920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.680234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.680399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.680599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.680768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.680918 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.681073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.681260 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.681417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.681619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.681783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.681940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.682097 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.682293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.682450 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.682612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.682767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.682956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.683120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.683280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.683436 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.683654 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.683813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.683962 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.684282 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.684454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.684650 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.684824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.684985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.685134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.685366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.685523 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.685713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.685882 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.686038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.686188 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.686385 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.686552 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.686710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.686860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.687658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.687827 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.687979 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.688138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.688339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.688504 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.688660 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.688811 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.689019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.689195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.689353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.689509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.689658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.689807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.690020 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.690185 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.690335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.690483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.690692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.690859 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.691016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.691173 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.691371 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.691568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.691726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.691876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.692081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.692249 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.692399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.692558 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.692759 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.692925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.693088 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.693238 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.693432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.693599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.693754 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.693911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.694073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.694232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.694429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.694677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.694840 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.695030 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.695195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.695404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.695617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.695788 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.695949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.696111 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.696267 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.696463 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.696619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.696820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.696994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.697188 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.697339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.697488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.697636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.697794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.697949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.698107 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.698264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.698420 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.698610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.698774 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.698925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.699082 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.699239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.699388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.699609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.699778 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.699949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.700100 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.700330 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.700488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.700712 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.701008 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.701182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.701341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.701491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.701687 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.701851 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.702061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.702230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.702394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.702553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.702730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.702879 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.703090 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.703261 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.703412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.703623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.703780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.703929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.704086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.704236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.704442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.704609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.704765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.704915 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.705129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.705281 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.705429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.705578 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.705726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.705875 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.706036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.706190 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.706347 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.706509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.706663 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.706813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.706969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.707119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.707341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.707498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.707731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.707888 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.708051 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.708207 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.708364 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.708521 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.708680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.708834 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.708985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.709132 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.709286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.709443 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.709604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.709754 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.709909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.710058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.710217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.710382 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.710532 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.710759 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.710917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.711089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.711243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.711403 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.711599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.711836 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.712034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.712192 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.712393 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.712551 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.712750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.712908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.713071 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.713229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.713451 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.713617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.713773 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.713924 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.714121 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.714278 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.714486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.714642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.714833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.714990 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.715191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.715358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.715551 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.715709 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.715900 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.716059 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.716278 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.716563 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.716720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.716942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.717101 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.717257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.717414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.717835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.717987 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.718194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.718862 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.719062 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.719220 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.719428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.719637 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.719799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.719956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.720112 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.720271 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.720429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.720597 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.720785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.720950 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.721137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.721308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.721459 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.721607 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.721813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.721971 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.722126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98183) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 03:25:38.722355 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.722513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.722807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.723156 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.723565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.723958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.724318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.724719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.725076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.725434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.725785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.726133 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.726481 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.726832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.727188 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.727610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.727967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.728309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.728777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.729129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.729488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.729849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.730199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.730569 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.730949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.731331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.731737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.732083 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.732427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.732770 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.733117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.733505 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.734463 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.734839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.735210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.735609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.735972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.736326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.736680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.737033 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.737387 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.737750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.738109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.738470 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.738822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.739188 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.739553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.739920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.740264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.740619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.740971 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.741698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.741698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.742035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.742401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.742753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.743118 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.743469 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.743861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.744229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.744588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.744939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.745321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.745673 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.746027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.746688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.746996 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.747348 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.747727 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.748102 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.748478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.748822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.749191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.749577 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.749945 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.750302 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.750654 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.751028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.751384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.751767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.752153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.752448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.752804 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.753163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.753531 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.753898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.754265 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.754620 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.755014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.755366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.755874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.756158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:25:38.756435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98184) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 03:25:38.758427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_db.sqlalchemy.engines [None req-486df125-4889-4f07-9121-f94801d57382 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98183) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:25:38.791862 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_db.sqlalchemy.engines [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98184) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:25:39.022392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.context [None req-486df125-4889-4f07-9121-f94801d57382 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b064fdc-543f-4d05-b0d7-96b33fa238fb(cell1) {{(pid=98183) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 03:25:39.027882 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-486df125-4889-4f07-9121-f94801d57382 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:25:39.029735 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-486df125-4889-4f07-9121-f94801d57382 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:25:39.030618 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-486df125-4889-4f07-9121-f94801d57382 None None] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:25:39.033350 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-486df125-4889-4f07-9121-f94801d57382 None None] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:25:39.053635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.context [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1b064fdc-543f-4d05-b0d7-96b33fa238fb(cell1) {{(pid=98184) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 03:25:39.059211 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:25:39.062307 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_db.sqlalchemy.engines [None req-486df125-4889-4f07-9121-f94801d57382 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98183) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:25:39.062434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:25:39.062519 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_db.sqlalchemy.engines [None req-486df125-4889-4f07-9121-f94801d57382 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98183) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:25:39.062596 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:25:39.064285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:25:39.089841 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_db.sqlalchemy.engines [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98184) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:25:39.090758 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_db.sqlalchemy.engines [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98184) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:25:39.093977 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_db.sqlalchemy.engines [None req-486df125-4889-4f07-9121-f94801d57382 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98183) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:25:39.122686 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_db.sqlalchemy.engines [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98184) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:25:39.176711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:25:39.176711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: from cryptography.utils import int_from_bytes Feb 17 03:25:39.177188 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:25:39.177188 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: from cryptography.utils import int_from_bytes Feb 17 03:25:39.204981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:25:39.204981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: from cryptography.utils import int_from_bytes Feb 17 03:25:39.205276 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:25:39.205276 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: from cryptography.utils import int_from_bytes Feb 17 03:25:39.255710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-486df125-4889-4f07-9121-f94801d57382 None None] Loading Gnome Feb 17 03:25:39.276835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-486df125-4889-4f07-9121-f94801d57382 None None] Loading Google Feb 17 03:25:39.280273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-486df125-4889-4f07-9121-f94801d57382 None None] Loading Windows (alt) Feb 17 03:25:39.282547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Loading Gnome Feb 17 03:25:39.285541 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-486df125-4889-4f07-9121-f94801d57382 None None] Loading file Feb 17 03:25:39.286656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-486df125-4889-4f07-9121-f94801d57382 None None] Loading keyczar Feb 17 03:25:39.287375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-486df125-4889-4f07-9121-f94801d57382 None None] Loading multi Feb 17 03:25:39.288398 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-486df125-4889-4f07-9121-f94801d57382 None None] Loading pyfs Feb 17 03:25:39.303234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Loading Google Feb 17 03:25:39.306716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Loading Windows (alt) Feb 17 03:25:39.311345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Loading file Feb 17 03:25:39.312506 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Loading keyczar Feb 17 03:25:39.312956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Loading multi Feb 17 03:25:39.313944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO keyring.backend [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Loading pyfs Feb 17 03:25:39.680529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: WARNING keystonemiddleware.auth_token [None req-486df125-4889-4f07-9121-f94801d57382 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:25:39.688759 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: WARNING keystonemiddleware.auth_token [None req-486df125-4889-4f07-9121-f94801d57382 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:25:39.696672 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: WARNING keystonemiddleware.auth_token [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:25:39.704487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: WARNING keystonemiddleware.auth_token [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:25:39.922984 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: WARNING keystonemiddleware.auth_token [None req-486df125-4889-4f07-9121-f94801d57382 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:25:39.928716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: WARNING keystonemiddleware.auth_token [None req-486df125-4889-4f07-9121-f94801d57382 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:25:39.934379 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5572281839c0 pid: 98183 (default app) Feb 17 03:25:39.936148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: WARNING keystonemiddleware.auth_token [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:25:39.942455 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: WARNING keystonemiddleware.auth_token [None req-6b932350-77cc-4099-bfe8-58bf3ee3848f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:25:39.948038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5572281839c0 pid: 98184 (default app) Feb 17 03:26:19.624906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-14937299-0016-4492-8cbf-14642844a145 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] Action: 'create', calling method: .version_select at 0x7f012fae22f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2141344608", "metadata": {"Type": "work"}}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:19.628004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-14937299-0016-4492-8cbf-14642844a145 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:26:19.628923 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-14937299-0016-4492-8cbf-14642844a145 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.179142 Feb 17 03:26:19.629874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Feb 17 03:26:18 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:26:19.963994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1519387335", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "networks": [{"uuid": "6faf03f6-9eb3-4fe8-b4b1-82cc55937f06"}]}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:20.126853 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b6a6acbd-e047-44f2-ba33-91a19b9ce89a tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Action: 'create', calling method: .version_select at 0x7f012fae32f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-142740863"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:20.514138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] validate_networks() for [('6faf03f6-9eb3-4fe8-b4b1-82cc55937f06', None, None, None)] {{(pid=98183) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:26:21.450663 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b6a6acbd-e047-44f2-ba33-91a19b9ce89a tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.685140 Feb 17 03:26:21.451529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 1/2] 10.222.0.46 () {60 vars in 1145 bytes} [Wed Feb 17 03:26:18 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 2688 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 17 03:26:21.457221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7db24f52-05a9-48f8-a55d-0a661d907239 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] Action: 'create', calling method: .version_select at 0x7f012fae3ae8>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1306188589", "metadata": {"Type": "work"}}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:21.458864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7db24f52-05a9-48f8-a55d-0a661d907239 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:26:21.459722 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7db24f52-05a9-48f8-a55d-0a661d907239 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007042 Feb 17 03:26:21.474684 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Feb 17 03:26:21 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:26:21.479991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c69dcfb0-96cd-4183-a32b-0056e59aa369 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012fac2268>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:21.600298 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c69dcfb0-96cd-4183-a32b-0056e59aa369 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025" status: 200 len: 344 microversion: 2.1 time: 0.124013 Feb 17 03:26:21.600915 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 3/4] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:26:21 2021] GET /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 => generated 344 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:26:21.609985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c2d0f06a-ac9a-4541-9b07-2c28172e3708 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] Action: 'create', calling method: .version_select at 0x7f012faadd08>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1444060734", "metadata": {"Type": "work"}}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:21.611318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c2d0f06a-ac9a-4541-9b07-2c28172e3708 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:26:21.612322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c2d0f06a-ac9a-4541-9b07-2c28172e3708 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010442 Feb 17 03:26:21.612899 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 4/5] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Feb 17 03:26:21 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:26:21.622509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9aed265f-d34f-4934-94a4-9fd2558633fd tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] Calling method '.version_select at 0x7f012fac2598>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:21.698565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-9aed265f-d34f-4934-94a4-9fd2558633fd tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] HTTP exception thrown: Volume tempest-invalid-1207166171 could not be found. Feb 17 03:26:21.699457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9aed265f-d34f-4934-94a4-9fd2558633fd tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] Returning 404 to user: Volume tempest-invalid-1207166171 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:26:21.700598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9aed265f-d34f-4934-94a4-9fd2558633fd tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1207166171" status: 404 len: 99 microversion: 2.1 time: 0.082134 Feb 17 03:26:21.701690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 5/6] 10.222.0.46 () {58 vars in 1208 bytes} [Wed Feb 17 03:26:21 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1207166171 => generated 99 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 17 03:26:21.710756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0f866253-2491-4548-a5c8-dce0789a55af tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003797 Feb 17 03:26:21.715761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 6/7] 10.222.0.46 () {58 vars in 1130 bytes} [Wed Feb 17 03:26:21 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 17 03:26:21.721534 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1d01dc1c-cc06-45aa-9f78-8c2e94f5eb18 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004488 Feb 17 03:26:21.722949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 7/8] 10.222.0.46 () {58 vars in 1127 bytes} [Wed Feb 17 03:26:21 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 17 03:26:21.732791 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-364aa8c3-2edc-47c9-9022-ae8402c985b0 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] Calling method '.version_select at 0x7f012faad950>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:21.807232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-364aa8c3-2edc-47c9-9022-ae8402c985b0 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] HTTP exception thrown: Volume b46dfff9-5851-4113-ae26-bdcf5fc5429a could not be found. Feb 17 03:26:21.808179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-364aa8c3-2edc-47c9-9022-ae8402c985b0 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] Returning 404 to user: Volume b46dfff9-5851-4113-ae26-bdcf5fc5429a could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:26:21.809396 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-364aa8c3-2edc-47c9-9022-ae8402c985b0 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/b46dfff9-5851-4113-ae26-bdcf5fc5429a" status: 404 len: 109 microversion: 2.1 time: 0.081019 Feb 17 03:26:21.810198 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 8/9] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Feb 17 03:26:21 2021] DELETE /compute/v2.1/os-volumes/b46dfff9-5851-4113-ae26-bdcf5fc5429a => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:26:21.822524 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b4099ed7-a33d-4545-b5fe-516980473555 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] Calling method '.version_select at 0x7f012fac28c8>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:21.927560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-b4099ed7-a33d-4545-b5fe-516980473555 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] HTTP exception thrown: Volume 4c81bee9-1871-4720-bc2a-51b4a090fc4b could not be found. Feb 17 03:26:21.928401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b4099ed7-a33d-4545-b5fe-516980473555 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] Returning 404 to user: Volume 4c81bee9-1871-4720-bc2a-51b4a090fc4b could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:26:21.929571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b4099ed7-a33d-4545-b5fe-516980473555 tempest-VolumesNegativeTest-287195937 tempest-VolumesNegativeTest-287195937-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/4c81bee9-1871-4720-bc2a-51b4a090fc4b" status: 404 len: 109 microversion: 2.1 time: 0.113495 Feb 17 03:26:21.940445 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 9/10] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:26:21 2021] GET /compute/v2.1/os-volumes/4c81bee9-1871-4720-bc2a-51b4a090fc4b => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:26:22.426073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Flavor limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:26:22.427765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Image limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:26:22.429085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Flavor pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:26:22.430652 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Image pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:26:22.431748 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:26:22.460967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:22.464914 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:22.473646 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:22.474505 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:22.522826 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Getting quotas for project aa60503a7ed745c896b1149681ae4d95. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:26:22.533253 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Getting quotas for user 560d1af7aacc4347a22fb40a5d0bb5f8 and project aa60503a7ed745c896b1149681ae4d95. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:26:22.552010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Going to run 1 instances... {{(pid=98183) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:26:22.556305 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:26:22.614136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-65525600-f09c-4169-b4d1-3c5d571a1009 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012faadae8>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:22.684891 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9e18f64c-b669-4d19-bc3b-273e747cb33b tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.053445 Feb 17 03:26:22.686276 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 2/11] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:26:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 3056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:26:22.700884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3f501959-096e-4b9e-85f8-b220d1a31a12 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:22.702045 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3f501959-096e-4b9e-85f8-b220d1a31a12 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:22.837282 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-65525600-f09c-4169-b4d1-3c5d571a1009 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025" status: 200 len: 345 microversion: 2.1 time: 0.227009 Feb 17 03:26:22.837866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 10/12] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:26:22 2021] GET /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 => generated 345 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:26:22.849813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-dc94c3ce-94b0-4d58-aad1-f9a53a98e44e tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Action: 'create', calling method: .version_select at 0x7f012fac2730>, body: {"snapshot": {"volume_id": "dcd78ea3-8ae0-45e7-aabd-3a3d6856c025", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-18532841"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:22.902879 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3f501959-096e-4b9e-85f8-b220d1a31a12 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:22.923343 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3f501959-096e-4b9e-85f8-b220d1a31a12 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1215 microversion: 2.1 time: 0.228757 Feb 17 03:26:22.928333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 3/13] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:22 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:26:23.470617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-dc94c3ce-94b0-4d58-aad1-f9a53a98e44e tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.624607 Feb 17 03:26:23.471264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 11/14] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Feb 17 03:26:22 2021] POST /compute/v2.1/os-snapshots => generated 285 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:26:23.481743 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3dc39f0b-551b-48eb-95a5-4f18aad8fb50 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012fa7dae8>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:23.656410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3dc39f0b-551b-48eb-95a5-4f18aad8fb50 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4" status: 200 len: 285 microversion: 2.1 time: 0.177355 Feb 17 03:26:23.657989 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 4/15] 10.222.0.46 () {58 vars in 1241 bytes} [Wed Feb 17 03:26:23 2021] GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4 => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:26:23.672774 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-deeec73f-f8f4-4d54-aaf6-e3a3190b280c tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012faadd08>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:23.737675 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-deeec73f-f8f4-4d54-aaf6-e3a3190b280c tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.073642 Feb 17 03:26:23.738286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 12/16] 10.222.0.46 () {58 vars in 1130 bytes} [Wed Feb 17 03:26:23 2021] GET /compute/v2.1/os-snapshots => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:26:23.750781 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-80032728-3c1c-4c1c-9e55-c8986ee00b70 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012fa7d9d8>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:23.916623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-80032728-3c1c-4c1c-9e55-c8986ee00b70 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4" status: 200 len: 285 microversion: 2.1 time: 0.170959 Feb 17 03:26:23.921652 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 5/17] 10.222.0.46 () {58 vars in 1241 bytes} [Wed Feb 17 03:26:23 2021] GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:26:23.946110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ad3709ee-54e0-46a2-8235-9448e800a134 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:23.947198 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ad3709ee-54e0-46a2-8235-9448e800a134 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:24.160142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ad3709ee-54e0-46a2-8235-9448e800a134 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:24.189033 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ad3709ee-54e0-46a2-8235-9448e800a134 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1215 microversion: 2.1 time: 0.246866 Feb 17 03:26:24.189685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 13/18] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:23 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1215 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:24.930074 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5f55e45c-9d21-4bf4-8618-4acdbf3ed691 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012f143ea0>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:25.046370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5f55e45c-9d21-4bf4-8618-4acdbf3ed691 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4" status: 200 len: 285 microversion: 2.1 time: 0.121057 Feb 17 03:26:25.052010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 6/19] 10.222.0.46 () {58 vars in 1241 bytes} [Wed Feb 17 03:26:24 2021] GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4 => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:26:25.213143 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bab60637-99f6-4ed9-a675-ed58990372b1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:25.216134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bab60637-99f6-4ed9-a675-ed58990372b1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:25.235956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bab60637-99f6-4ed9-a675-ed58990372b1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:25.238520 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bab60637-99f6-4ed9-a675-ed58990372b1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:25.239478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bab60637-99f6-4ed9-a675-ed58990372b1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:25.240059 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bab60637-99f6-4ed9-a675-ed58990372b1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:25.469646 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bab60637-99f6-4ed9-a675-ed58990372b1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:25.487016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bab60637-99f6-4ed9-a675-ed58990372b1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1219 microversion: 2.1 time: 0.283606 Feb 17 03:26:25.487659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 14/20] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:25 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1219 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:26.058461 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-aa2b31e0-6bc8-454b-befe-c6bfa6bbb7e5 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012f15f0d0>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:26.132790 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-aa2b31e0-6bc8-454b-befe-c6bfa6bbb7e5 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4" status: 200 len: 285 microversion: 2.1 time: 0.078195 Feb 17 03:26:26.133394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 7/21] 10.222.0.46 () {58 vars in 1241 bytes} [Wed Feb 17 03:26:26 2021] GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4 => generated 285 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:26:26.507716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bbe15530-2078-4ab1-ab5c-b188257ab186 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:26.508385 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bbe15530-2078-4ab1-ab5c-b188257ab186 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:26.527635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bbe15530-2078-4ab1-ab5c-b188257ab186 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:26.528394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bbe15530-2078-4ab1-ab5c-b188257ab186 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:26.529478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bbe15530-2078-4ab1-ab5c-b188257ab186 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:26.530269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bbe15530-2078-4ab1-ab5c-b188257ab186 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:26.936114 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bbe15530-2078-4ab1-ab5c-b188257ab186 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:26.955384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bbe15530-2078-4ab1-ab5c-b188257ab186 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1219 microversion: 2.1 time: 0.452839 Feb 17 03:26:26.961988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 15/22] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:26 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1219 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:27.145584 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-05059347-93f4-4dc6-807e-b50601040db4 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012faad9d8>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:27.250242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-05059347-93f4-4dc6-807e-b50601040db4 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4" status: 200 len: 286 microversion: 2.1 time: 0.108206 Feb 17 03:26:27.250872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 16/23] 10.222.0.46 () {58 vars in 1241 bytes} [Wed Feb 17 03:26:27 2021] GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4 => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:26:27.262227 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-965082403", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "networks": [{"uuid": "14692b9d-40c8-4147-9ef2-2084ebbdc286"}]}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:27.264132 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5dc464d4-281d-47ea-b400-106aa440863e tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012f94da60>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:27.398033 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5dc464d4-281d-47ea-b400-106aa440863e tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4" status: 202 len: 0 microversion: 2.1 time: 0.139974 Feb 17 03:26:27.399306 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 17/24] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Feb 17 03:26:27 2021] DELETE /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:26:27.409098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-52b03000-64b9-4575-8818-2055f34886b0 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012f94d8c8>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:27.510773 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-52b03000-64b9-4575-8818-2055f34886b0 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4" status: 200 len: 285 microversion: 2.1 time: 0.106886 Feb 17 03:26:27.512060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 18/25] 10.222.0.46 () {58 vars in 1241 bytes} [Wed Feb 17 03:26:27 2021] GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4 => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:26:27.571285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] validate_networks() for [('14692b9d-40c8-4147-9ef2-2084ebbdc286', None, None, None)] {{(pid=98183) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:26:27.979494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3e5fb9d4-69d5-4216-b457-3ba9bb3ac72c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:27.980473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3e5fb9d4-69d5-4216-b457-3ba9bb3ac72c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:27.995323 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e5fb9d4-69d5-4216-b457-3ba9bb3ac72c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:27.996118 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e5fb9d4-69d5-4216-b457-3ba9bb3ac72c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:27.999896 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e5fb9d4-69d5-4216-b457-3ba9bb3ac72c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:28.000829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e5fb9d4-69d5-4216-b457-3ba9bb3ac72c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:28.550441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3e5fb9d4-69d5-4216-b457-3ba9bb3ac72c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:28.576662 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3e5fb9d4-69d5-4216-b457-3ba9bb3ac72c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1267 microversion: 2.1 time: 0.599150 Feb 17 03:26:28.581234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 19/26] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:27 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1267 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:28.588993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8ad88901-9aa1-42fd-a9f6-450465ff1a02 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012f95e598>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:28.674263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-8ad88901-9aa1-42fd-a9f6-450465ff1a02 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] HTTP exception thrown: Snapshot 292ff256-4237-4398-9f56-a10ccd2c5ff4 could not be found. Feb 17 03:26:28.674910 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8ad88901-9aa1-42fd-a9f6-450465ff1a02 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Returning 404 to user: Snapshot 292ff256-4237-4398-9f56-a10ccd2c5ff4 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:26:28.677132 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8ad88901-9aa1-42fd-a9f6-450465ff1a02 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4" status: 404 len: 111 microversion: 2.1 time: 0.093852 Feb 17 03:26:28.678394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 20/27] 10.222.0.46 () {58 vars in 1241 bytes} [Wed Feb 17 03:26:28 2021] GET /compute/v2.1/os-snapshots/292ff256-4237-4398-9f56-a10ccd2c5ff4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:26:28.687696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bd7d54ae-e001-46a0-b9b0-25940a004ba2 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f01378dbea0>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:28.960213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bd7d54ae-e001-46a0-b9b0-25940a004ba2 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025" status: 202 len: 0 microversion: 2.1 time: 0.277570 Feb 17 03:26:28.961104 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 21/28] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Feb 17 03:26:28 2021] DELETE /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:26:28.973355 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-42846622-dfb3-4cde-8d8f-a4fb28e00494 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012fac2730>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:29.141562 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-42846622-dfb3-4cde-8d8f-a4fb28e00494 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025" status: 200 len: 344 microversion: 2.1 time: 0.175925 Feb 17 03:26:29.142428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 22/29] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:26:28 2021] GET /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:26:29.156156 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Flavor limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:26:29.156612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Image limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:26:29.157147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Flavor pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:26:29.157578 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Image pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:26:29.158022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:26:29.178657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:29.179125 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:29.180201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:29.180847 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:29.220078 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Getting quotas for project 0ade3597251b451eb7a31a1c95528adf. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:26:29.234140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Getting quotas for user 41a15644050d496c9d4a641eb5f8f088 and project 0ade3597251b451eb7a31a1c95528adf. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:26:29.257971 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Going to run 1 instances... {{(pid=98183) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:26:29.261348 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:26:29.355063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3438251c-ff79-415f-955d-be9b7257e643 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.725616 Feb 17 03:26:29.356533 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 8/30] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:26:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 2728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 03:26:29.369679 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8d0acabf-bf37-4010-9a5c-da6fd357d4bc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:29.370567 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8d0acabf-bf37-4010-9a5c-da6fd357d4bc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:29.553514 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8d0acabf-bf37-4010-9a5c-da6fd357d4bc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:29.572860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8d0acabf-bf37-4010-9a5c-da6fd357d4bc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1217 microversion: 2.1 time: 0.203648 Feb 17 03:26:29.573956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 23/31] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:29 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:29.601190 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-546f47c7-1cc1-4f0d-8f46-f82389bcf2b4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:29.602046 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-546f47c7-1cc1-4f0d-8f46-f82389bcf2b4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:29.615500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-546f47c7-1cc1-4f0d-8f46-f82389bcf2b4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:29.618202 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-546f47c7-1cc1-4f0d-8f46-f82389bcf2b4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:29.620662 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-546f47c7-1cc1-4f0d-8f46-f82389bcf2b4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:29.622106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-546f47c7-1cc1-4f0d-8f46-f82389bcf2b4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:29.832728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-546f47c7-1cc1-4f0d-8f46-f82389bcf2b4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:29.848197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-546f47c7-1cc1-4f0d-8f46-f82389bcf2b4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1273 microversion: 2.1 time: 0.251884 Feb 17 03:26:29.849065 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 9/32] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:29 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1273 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:30.154718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2fe868f5-d94b-42f4-b185-f773098fe87a tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012f8eaf28>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:30.388680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-2fe868f5-d94b-42f4-b185-f773098fe87a tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] HTTP exception thrown: Volume dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 could not be found. Feb 17 03:26:30.389503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2fe868f5-d94b-42f4-b185-f773098fe87a tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Returning 404 to user: Volume dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:26:30.390643 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2fe868f5-d94b-42f4-b185-f773098fe87a tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025" status: 404 len: 109 microversion: 2.1 time: 0.239889 Feb 17 03:26:30.402969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 24/33] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:26:30 2021] GET /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 => generated 109 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:26:30.412831 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-816f3ea0-1e79-4032-9cc4-5439ab57a7de tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012f082b70>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:30.594266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e6eb4e39-18cb-4bc9-91c0-89607cd66acb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:30.595116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e6eb4e39-18cb-4bc9-91c0-89607cd66acb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:30.621014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-816f3ea0-1e79-4032-9cc4-5439ab57a7de tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] HTTP exception thrown: Volume dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 could not be found. Feb 17 03:26:30.622137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-816f3ea0-1e79-4032-9cc4-5439ab57a7de tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Returning 404 to user: Volume dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:26:30.623377 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-816f3ea0-1e79-4032-9cc4-5439ab57a7de tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025" status: 404 len: 109 microversion: 2.1 time: 0.218801 Feb 17 03:26:30.624416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 10/34] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Feb 17 03:26:30 2021] DELETE /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 => generated 109 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:26:30.640014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-817cfcf7-d62e-498c-ad3f-666c0a8e71a2 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Calling method '.version_select at 0x7f012fa7dae8>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:30.763624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e6eb4e39-18cb-4bc9-91c0-89607cd66acb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:30.791091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e6eb4e39-18cb-4bc9-91c0-89607cd66acb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1217 microversion: 2.1 time: 0.199138 Feb 17 03:26:30.792434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 25/35] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:30 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1217 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:30.821151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-817cfcf7-d62e-498c-ad3f-666c0a8e71a2 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] HTTP exception thrown: Volume dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 could not be found. Feb 17 03:26:30.821946 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-817cfcf7-d62e-498c-ad3f-666c0a8e71a2 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] Returning 404 to user: Volume dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:26:30.822987 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-817cfcf7-d62e-498c-ad3f-666c0a8e71a2 tempest-VolumesSnapshotsTestJSON-198921429 tempest-VolumesSnapshotsTestJSON-198921429-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025" status: 404 len: 109 microversion: 2.1 time: 0.194333 Feb 17 03:26:30.824029 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 11/36] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:26:30 2021] GET /compute/v2.1/os-volumes/dcd78ea3-8ae0-45e7-aabd-3a3d6856c025 => generated 109 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:26:30.867955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-26edd7e4-ef7d-4923-b607-26e5a119f279 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:30.868833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-26edd7e4-ef7d-4923-b607-26e5a119f279 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:30.892222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-26edd7e4-ef7d-4923-b607-26e5a119f279 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:30.895269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-26edd7e4-ef7d-4923-b607-26e5a119f279 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:30.896471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-26edd7e4-ef7d-4923-b607-26e5a119f279 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:30.899690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-26edd7e4-ef7d-4923-b607-26e5a119f279 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:31.173619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-26edd7e4-ef7d-4923-b607-26e5a119f279 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:31.188436 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-26edd7e4-ef7d-4923-b607-26e5a119f279 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1273 microversion: 2.1 time: 0.325748 Feb 17 03:26:31.189291 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 26/37] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:30 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1273 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:31.813098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c91db24b-51b1-4ce6-bf86-fba9e7b9287a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:31.814274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c91db24b-51b1-4ce6-bf86-fba9e7b9287a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:31.830667 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c91db24b-51b1-4ce6-bf86-fba9e7b9287a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:31.832176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c91db24b-51b1-4ce6-bf86-fba9e7b9287a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:31.835780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c91db24b-51b1-4ce6-bf86-fba9e7b9287a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:31.836537 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c91db24b-51b1-4ce6-bf86-fba9e7b9287a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:32.186037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c91db24b-51b1-4ce6-bf86-fba9e7b9287a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:32.196718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c91db24b-51b1-4ce6-bf86-fba9e7b9287a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1213 microversion: 2.1 time: 0.388464 Feb 17 03:26:32.207330 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-080a806c-ecbb-48bf-b6b2-64c46e6ce844 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:32.208348 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-080a806c-ecbb-48bf-b6b2-64c46e6ce844 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:32.224928 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-080a806c-ecbb-48bf-b6b2-64c46e6ce844 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:32.226138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-080a806c-ecbb-48bf-b6b2-64c46e6ce844 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:32.229409 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-080a806c-ecbb-48bf-b6b2-64c46e6ce844 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:32.230151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-080a806c-ecbb-48bf-b6b2-64c46e6ce844 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:32.245829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 12/38] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:31 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1213 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:32.587378 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-080a806c-ecbb-48bf-b6b2-64c46e6ce844 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:32.602148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-080a806c-ecbb-48bf-b6b2-64c46e6ce844 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1273 microversion: 2.1 time: 0.399395 Feb 17 03:26:32.616232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 27/39] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:32 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1273 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:26:33.250684 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ceac53b0-b4a0-46ce-a3d0-126151c603d2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:33.251987 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ceac53b0-b4a0-46ce-a3d0-126151c603d2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:33.274964 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ceac53b0-b4a0-46ce-a3d0-126151c603d2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:33.276572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ceac53b0-b4a0-46ce-a3d0-126151c603d2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:33.280436 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ceac53b0-b4a0-46ce-a3d0-126151c603d2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:33.282201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ceac53b0-b4a0-46ce-a3d0-126151c603d2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:33.544820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ceac53b0-b4a0-46ce-a3d0-126151c603d2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:33.584168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ceac53b0-b4a0-46ce-a3d0-126151c603d2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1213 microversion: 2.1 time: 0.331503 Feb 17 03:26:33.584842 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 13/40] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:33 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1213 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:26:33.635174 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-64099f57-2f86-4021-8e18-4914ba1841c7 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:33.636485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-64099f57-2f86-4021-8e18-4914ba1841c7 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:33.658786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-64099f57-2f86-4021-8e18-4914ba1841c7 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:33.659280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-64099f57-2f86-4021-8e18-4914ba1841c7 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:33.660148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-64099f57-2f86-4021-8e18-4914ba1841c7 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:33.660631 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-64099f57-2f86-4021-8e18-4914ba1841c7 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:34.000826 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-64099f57-2f86-4021-8e18-4914ba1841c7 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:34.025464 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-64099f57-2f86-4021-8e18-4914ba1841c7 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1273 microversion: 2.1 time: 0.394371 Feb 17 03:26:34.031375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 28/41] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:33 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1273 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:34.613008 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d7f03ab0-34cd-4ad8-b3a3-e2acc1d16678 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:34.613806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d7f03ab0-34cd-4ad8-b3a3-e2acc1d16678 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:34.632512 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7f03ab0-34cd-4ad8-b3a3-e2acc1d16678 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:34.637432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7f03ab0-34cd-4ad8-b3a3-e2acc1d16678 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:34.638537 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7f03ab0-34cd-4ad8-b3a3-e2acc1d16678 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:34.639250 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7f03ab0-34cd-4ad8-b3a3-e2acc1d16678 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:34.933291 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d7f03ab0-34cd-4ad8-b3a3-e2acc1d16678 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:34.947637 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d7f03ab0-34cd-4ad8-b3a3-e2acc1d16678 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1213 microversion: 2.1 time: 0.345500 Feb 17 03:26:34.952641 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 14/42] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:34 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1213 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:35.051420 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-86018447-d07f-4005-a7f0-6faf5e580599 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:35.052380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-86018447-d07f-4005-a7f0-6faf5e580599 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:35.076783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-86018447-d07f-4005-a7f0-6faf5e580599 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:35.077403 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-86018447-d07f-4005-a7f0-6faf5e580599 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:35.078299 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-86018447-d07f-4005-a7f0-6faf5e580599 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:35.078794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-86018447-d07f-4005-a7f0-6faf5e580599 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:35.552058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-86018447-d07f-4005-a7f0-6faf5e580599 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:35.580906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-86018447-d07f-4005-a7f0-6faf5e580599 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1273 microversion: 2.1 time: 0.519422 Feb 17 03:26:35.585048 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 29/43] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:35 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1273 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:35.979176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4ca09011-8e96-470f-8ef0-5b9197cb3583 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:35.980942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4ca09011-8e96-470f-8ef0-5b9197cb3583 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:35.989963 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ca09011-8e96-470f-8ef0-5b9197cb3583 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:35.990928 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ca09011-8e96-470f-8ef0-5b9197cb3583 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:35.992112 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ca09011-8e96-470f-8ef0-5b9197cb3583 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:35.993423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ca09011-8e96-470f-8ef0-5b9197cb3583 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:36.533480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4ca09011-8e96-470f-8ef0-5b9197cb3583 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:36.553486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4ca09011-8e96-470f-8ef0-5b9197cb3583 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1213 microversion: 2.1 time: 0.584395 Feb 17 03:26:36.554108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 15/44] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:35 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1213 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:36.605113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fe831f8e-60fc-48bf-9baa-e4733dd85b31 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:36.605773 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fe831f8e-60fc-48bf-9baa-e4733dd85b31 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:36.640602 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe831f8e-60fc-48bf-9baa-e4733dd85b31 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:36.643945 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe831f8e-60fc-48bf-9baa-e4733dd85b31 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:36.646063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe831f8e-60fc-48bf-9baa-e4733dd85b31 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:36.647390 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe831f8e-60fc-48bf-9baa-e4733dd85b31 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:37.353884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fe831f8e-60fc-48bf-9baa-e4733dd85b31 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:37.378594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fe831f8e-60fc-48bf-9baa-e4733dd85b31 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1273 microversion: 2.1 time: 0.778141 Feb 17 03:26:37.379593 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 30/45] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:36 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1273 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:37.571352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1e2b5032-2349-413e-a061-29fe988e3c20 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:37.572305 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1e2b5032-2349-413e-a061-29fe988e3c20 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:37.587155 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1e2b5032-2349-413e-a061-29fe988e3c20 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:37.588197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1e2b5032-2349-413e-a061-29fe988e3c20 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:37.592200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1e2b5032-2349-413e-a061-29fe988e3c20 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:37.594324 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1e2b5032-2349-413e-a061-29fe988e3c20 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:37.872376 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1e2b5032-2349-413e-a061-29fe988e3c20 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:37.886292 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1e2b5032-2349-413e-a061-29fe988e3c20 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1269 microversion: 2.1 time: 0.319454 Feb 17 03:26:37.887740 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 16/46] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:37 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1269 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:38.396961 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2cec5c94-bd8d-4731-990f-96a62b704456 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:38.397752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2cec5c94-bd8d-4731-990f-96a62b704456 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:38.410123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2cec5c94-bd8d-4731-990f-96a62b704456 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:38.424328 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2cec5c94-bd8d-4731-990f-96a62b704456 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:38.425588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2cec5c94-bd8d-4731-990f-96a62b704456 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:38.426266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2cec5c94-bd8d-4731-990f-96a62b704456 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:38.798573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2cec5c94-bd8d-4731-990f-96a62b704456 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:38.808031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2cec5c94-bd8d-4731-990f-96a62b704456 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1273 microversion: 2.1 time: 0.415270 Feb 17 03:26:38.813715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 31/47] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:38 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1273 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:38.907445 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5fe191a6-d862-4cf7-986b-79afd35bbd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:38.908478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5fe191a6-d862-4cf7-986b-79afd35bbd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:38.932812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5fe191a6-d862-4cf7-986b-79afd35bbd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:38.935422 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5fe191a6-d862-4cf7-986b-79afd35bbd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:38.937801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5fe191a6-d862-4cf7-986b-79afd35bbd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:38.938444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5fe191a6-d862-4cf7-986b-79afd35bbd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:39.236135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5fe191a6-d862-4cf7-986b-79afd35bbd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:39.267358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5fe191a6-d862-4cf7-986b-79afd35bbd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1269 microversion: 2.1 time: 0.365407 Feb 17 03:26:39.274489 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 17/48] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:38 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1269 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:39.838374 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-941a4777-edc0-4694-90a4-1650e1a9c9f8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:39.839013 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-941a4777-edc0-4694-90a4-1650e1a9c9f8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:39.852971 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-941a4777-edc0-4694-90a4-1650e1a9c9f8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:39.864265 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-941a4777-edc0-4694-90a4-1650e1a9c9f8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:39.865384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-941a4777-edc0-4694-90a4-1650e1a9c9f8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:39.866095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-941a4777-edc0-4694-90a4-1650e1a9c9f8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:40.292891 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d95a0b31-952e-4e28-8a89-6a2948bc86fa tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:40.293849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d95a0b31-952e-4e28-8a89-6a2948bc86fa tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:40.308319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d95a0b31-952e-4e28-8a89-6a2948bc86fa tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:40.312199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d95a0b31-952e-4e28-8a89-6a2948bc86fa tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:40.313380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d95a0b31-952e-4e28-8a89-6a2948bc86fa tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:40.314109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d95a0b31-952e-4e28-8a89-6a2948bc86fa tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:40.315550 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-941a4777-edc0-4694-90a4-1650e1a9c9f8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:40.329893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-941a4777-edc0-4694-90a4-1650e1a9c9f8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1315 microversion: 2.1 time: 0.495336 Feb 17 03:26:40.330513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 32/49] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:39 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:40.542791 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d95a0b31-952e-4e28-8a89-6a2948bc86fa tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:40.553142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d95a0b31-952e-4e28-8a89-6a2948bc86fa tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1269 microversion: 2.1 time: 0.264637 Feb 17 03:26:40.553765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 18/50] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:40 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1269 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:41.349695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3d81a08a-e1c6-491a-9761-e1c7791b4828 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:41.350614 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3d81a08a-e1c6-491a-9761-e1c7791b4828 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:41.362610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d81a08a-e1c6-491a-9761-e1c7791b4828 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:41.366291 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d81a08a-e1c6-491a-9761-e1c7791b4828 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:41.367308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d81a08a-e1c6-491a-9761-e1c7791b4828 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:41.367980 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d81a08a-e1c6-491a-9761-e1c7791b4828 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:41.571859 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bd64e910-30ac-45c0-8e12-01eee1f910d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:41.572644 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bd64e910-30ac-45c0-8e12-01eee1f910d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:41.581495 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bd64e910-30ac-45c0-8e12-01eee1f910d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:41.582110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bd64e910-30ac-45c0-8e12-01eee1f910d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:41.583026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bd64e910-30ac-45c0-8e12-01eee1f910d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:41.583615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bd64e910-30ac-45c0-8e12-01eee1f910d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:41.741934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bd64e910-30ac-45c0-8e12-01eee1f910d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:41.757279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bd64e910-30ac-45c0-8e12-01eee1f910d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1269 microversion: 2.1 time: 0.189207 Feb 17 03:26:41.768444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 19/51] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:41 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1269 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:41.953899 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3d81a08a-e1c6-491a-9761-e1c7791b4828 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:41.968026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3d81a08a-e1c6-491a-9761-e1c7791b4828 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1315 microversion: 2.1 time: 0.622863 Feb 17 03:26:41.969141 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 33/52] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:41 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:42.787284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cf93a825-84cb-49d6-a069-7bb5f02def9c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:42.788929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cf93a825-84cb-49d6-a069-7bb5f02def9c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:42.823032 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf93a825-84cb-49d6-a069-7bb5f02def9c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:42.824865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf93a825-84cb-49d6-a069-7bb5f02def9c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:42.831937 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf93a825-84cb-49d6-a069-7bb5f02def9c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:42.836475 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf93a825-84cb-49d6-a069-7bb5f02def9c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:42.987398 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cbbb4c95-bfac-4766-8f76-ad4e5d6ebe6d tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:42.988324 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cbbb4c95-bfac-4766-8f76-ad4e5d6ebe6d tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:43.007151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cbbb4c95-bfac-4766-8f76-ad4e5d6ebe6d tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:43.007677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cbbb4c95-bfac-4766-8f76-ad4e5d6ebe6d tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:43.008521 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cbbb4c95-bfac-4766-8f76-ad4e5d6ebe6d tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:43.009008 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cbbb4c95-bfac-4766-8f76-ad4e5d6ebe6d tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:43.177972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cf93a825-84cb-49d6-a069-7bb5f02def9c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:43.191014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cf93a825-84cb-49d6-a069-7bb5f02def9c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1275 microversion: 2.1 time: 0.418115 Feb 17 03:26:43.191910 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 20/53] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:42 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1275 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:44.209524 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1ef21c53-20bc-4c49-89c5-f2fd8d31dc0e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:44.210106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1ef21c53-20bc-4c49-89c5-f2fd8d31dc0e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:44.229087 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1ef21c53-20bc-4c49-89c5-f2fd8d31dc0e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:44.229578 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1ef21c53-20bc-4c49-89c5-f2fd8d31dc0e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:44.230407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1ef21c53-20bc-4c49-89c5-f2fd8d31dc0e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:44.230886 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1ef21c53-20bc-4c49-89c5-f2fd8d31dc0e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:44.262465 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cbbb4c95-bfac-4766-8f76-ad4e5d6ebe6d tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:44.293847 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cbbb4c95-bfac-4766-8f76-ad4e5d6ebe6d tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1315 microversion: 2.1 time: 1.311451 Feb 17 03:26:44.294633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 34/54] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:42 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1315 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:44.486718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1ef21c53-20bc-4c49-89c5-f2fd8d31dc0e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:44.505159 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1ef21c53-20bc-4c49-89c5-f2fd8d31dc0e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1275 microversion: 2.1 time: 0.299377 Feb 17 03:26:44.516834 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 21/55] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:44 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1275 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:44.981434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-47fd94aa-a6e3-4529-ba99-ec37f905bb5d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'create', calling method: .version_select at 0x7f012f8eae18>, body: {"keypair": {"name": "tempest-keypair-1522223405"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:45.102593 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-47fd94aa-a6e3-4529-ba99-ec37f905bb5d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Getting quotas for project 7d8b1f2f62fe46bd86f2158ff4c88376. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:26:45.105660 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-47fd94aa-a6e3-4529-ba99-ec37f905bb5d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Getting quotas for user 4b5d48272f134d44a615b37af1bbbed6 and project 7d8b1f2f62fe46bd86f2158ff4c88376. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:26:45.313546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f4416f2a-f943-45a0-8786-cf75d1c7d621 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:45.314917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f4416f2a-f943-45a0-8786-cf75d1c7d621 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:45.330728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f4416f2a-f943-45a0-8786-cf75d1c7d621 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:45.337760 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f4416f2a-f943-45a0-8786-cf75d1c7d621 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:45.342392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f4416f2a-f943-45a0-8786-cf75d1c7d621 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:45.344278 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f4416f2a-f943-45a0-8786-cf75d1c7d621 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:45.792839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-47fd94aa-a6e3-4529-ba99-ec37f905bb5d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Getting quotas for project 7d8b1f2f62fe46bd86f2158ff4c88376. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:26:45.797399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-47fd94aa-a6e3-4529-ba99-ec37f905bb5d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Getting quotas for user 4b5d48272f134d44a615b37af1bbbed6 and project 7d8b1f2f62fe46bd86f2158ff4c88376. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:26:45.817575 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-47fd94aa-a6e3-4529-ba99-ec37f905bb5d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.143506 Feb 17 03:26:45.818496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 35/56] 10.222.0.46 () {62 vars in 1189 bytes} [Wed Feb 17 03:26:44 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1145 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 17 03:26:45.823503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8bcebb05-2202-4ce9-b2da-a3411c573c6c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:45.824355 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8bcebb05-2202-4ce9-b2da-a3411c573c6c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:45.842063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8bcebb05-2202-4ce9-b2da-a3411c573c6c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:45.842611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8bcebb05-2202-4ce9-b2da-a3411c573c6c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:45.843549 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8bcebb05-2202-4ce9-b2da-a3411c573c6c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:45.844372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8bcebb05-2202-4ce9-b2da-a3411c573c6c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:46.113378 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8bcebb05-2202-4ce9-b2da-a3411c573c6c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:46.132112 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8bcebb05-2202-4ce9-b2da-a3411c573c6c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1275 microversion: 2.1 time: 0.312165 Feb 17 03:26:46.133517 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 36/57] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:45 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1275 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:47.016322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f4416f2a-f943-45a0-8786-cf75d1c7d621 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:47.088671 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f4416f2a-f943-45a0-8786-cf75d1c7d621 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1315 microversion: 2.1 time: 1.780285 Feb 17 03:26:47.092410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 22/58] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:45 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1315 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:47.159190 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ae80ffb4-84fc-452a-8acf-bfc828461e71 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:47.160067 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ae80ffb4-84fc-452a-8acf-bfc828461e71 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:47.171456 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ae80ffb4-84fc-452a-8acf-bfc828461e71 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:47.172269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ae80ffb4-84fc-452a-8acf-bfc828461e71 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:47.173325 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ae80ffb4-84fc-452a-8acf-bfc828461e71 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:47.173945 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ae80ffb4-84fc-452a-8acf-bfc828461e71 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:47.531036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ae80ffb4-84fc-452a-8acf-bfc828461e71 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:47.549630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ae80ffb4-84fc-452a-8acf-bfc828461e71 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1275 microversion: 2.1 time: 0.396689 Feb 17 03:26:47.550534 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 37/59] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:47 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1275 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:48.261998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-0adf8424-3b2c-41e0-9ae6-d9660f2ac87e req-3e449f73-2782-4097-a389-e8a67108e372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3", "tag": "720dde26-b646-463c-981e-62d7f5b221b3"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:48.265324 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:26:48.265324 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:26:48.289617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-0adf8424-3b2c-41e0-9ae6-d9660f2ac87e req-3e449f73-2782-4097-a389-e8a67108e372 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:48.294197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-0adf8424-3b2c-41e0-9ae6-d9660f2ac87e req-3e449f73-2782-4097-a389-e8a67108e372 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:48.333218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-879909286", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7c8931b5-d986-48a9-8797-db4c2b0cb489"}]}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:48.378560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-0adf8424-3b2c-41e0-9ae6-d9660f2ac87e req-3e449f73-2782-4097-a389-e8a67108e372 service nova] Creating event network-changed:720dde26-b646-463c-981e-62d7f5b221b3 for instance ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 on hv-cinder-75996 Feb 17 03:26:48.386353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-0adf8424-3b2c-41e0-9ae6-d9660f2ac87e req-3e449f73-2782-4097-a389-e8a67108e372 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98183) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:26:48.387858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8fcccdb-81da-4568-947e-37f9abca0638 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:48.388502 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8fcccdb-81da-4568-947e-37f9abca0638 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:48.389548 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8fcccdb-81da-4568-947e-37f9abca0638 None None] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:48.390254 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8fcccdb-81da-4568-947e-37f9abca0638 None None] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:48.417116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.compute.rpcapi [None req-f8fcccdb-81da-4568-947e-37f9abca0638 None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 17 03:26:48.432088 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8fcccdb-81da-4568-947e-37f9abca0638 None None] Releasing lock "compute-rpcapi-router" {{(pid=98183) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:26:48.491926 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f8fcccdb-81da-4568-947e-37f9abca0638 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.536851 Feb 17 03:26:48.492799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 23/60] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:26:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:26:48.498696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-04d63906-fe8d-43b2-9968-60d778803fc1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:48.502962 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-04d63906-fe8d-43b2-9968-60d778803fc1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:48.523119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-04d63906-fe8d-43b2-9968-60d778803fc1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:48.528143 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-04d63906-fe8d-43b2-9968-60d778803fc1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:48.529624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-04d63906-fe8d-43b2-9968-60d778803fc1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:48.530807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-04d63906-fe8d-43b2-9968-60d778803fc1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:48.548775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] validate_networks() for [('7c8931b5-d986-48a9-8797-db4c2b0cb489', None, None, None)] {{(pid=98184) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:26:49.773651 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-04d63906-fe8d-43b2-9968-60d778803fc1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:49.790209 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-04d63906-fe8d-43b2-9968-60d778803fc1 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1315 microversion: 2.1 time: 1.295567 Feb 17 03:26:49.792937 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 24/61] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:48 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1315 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:49.810320 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-60a22bcd-2d13-42bd-a3f8-58649873c93f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:49.812000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-60a22bcd-2d13-42bd-a3f8-58649873c93f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:49.823346 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-60a22bcd-2d13-42bd-a3f8-58649873c93f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:49.823994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-60a22bcd-2d13-42bd-a3f8-58649873c93f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:49.825372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-60a22bcd-2d13-42bd-a3f8-58649873c93f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:49.826050 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-60a22bcd-2d13-42bd-a3f8-58649873c93f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:51.607639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-60a22bcd-2d13-42bd-a3f8-58649873c93f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:51.625832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-60a22bcd-2d13-42bd-a3f8-58649873c93f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1317 microversion: 2.1 time: 1.829098 Feb 17 03:26:51.631620 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 25/62] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:49 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1317 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:51.641157 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-820a5c7d-88c8-44c6-8e90-6dfa0d3ab3a5 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:51.641157 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-820a5c7d-88c8-44c6-8e90-6dfa0d3ab3a5 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:51.673880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-820a5c7d-88c8-44c6-8e90-6dfa0d3ab3a5 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:51.674354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-820a5c7d-88c8-44c6-8e90-6dfa0d3ab3a5 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:51.675373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-820a5c7d-88c8-44c6-8e90-6dfa0d3ab3a5 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:51.676059 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-820a5c7d-88c8-44c6-8e90-6dfa0d3ab3a5 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:53.065643 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-820a5c7d-88c8-44c6-8e90-6dfa0d3ab3a5 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:53.079181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-820a5c7d-88c8-44c6-8e90-6dfa0d3ab3a5 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1315 microversion: 2.1 time: 1.446316 Feb 17 03:26:53.083471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 26/63] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:51 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1315 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:53.095498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c03ee324-e337-419d-bc71-951fec52583a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:53.096724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c03ee324-e337-419d-bc71-951fec52583a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:53.118928 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c03ee324-e337-419d-bc71-951fec52583a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:53.119608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c03ee324-e337-419d-bc71-951fec52583a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:53.120692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c03ee324-e337-419d-bc71-951fec52583a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:53.121394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c03ee324-e337-419d-bc71-951fec52583a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:53.384205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Flavor limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:26:53.384678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Image limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:26:53.385219 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Flavor pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:26:53.385675 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Image pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:26:53.386136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:26:53.397030 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:53.401134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:53.402342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:53.402987 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:53.426146 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Getting quotas for project 11a5692210d54de3b217536dd49aa377. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:26:53.431682 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Getting quotas for user 6816ad0cd5f846ef8a759f5a2ded11c2 and project 11a5692210d54de3b217536dd49aa377. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:26:53.452695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Going to run 1 instances... {{(pid=98184) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:26:53.456368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:26:53.566324 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ef3f6a1e-7d68-43b1-af91-f62617daa5c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.516387 Feb 17 03:26:53.567280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 38/64] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:26:48 2021] POST /compute/v2.1/servers => generated 383 bytes in 5518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:26:53.622147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f7da37dd-edf4-4a4b-9202-24e02100e2b5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:53.622977 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f7da37dd-edf4-4a4b-9202-24e02100e2b5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:54.342089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f7da37dd-edf4-4a4b-9202-24e02100e2b5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:54.364748 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f7da37dd-edf4-4a4b-9202-24e02100e2b5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1221 microversion: 2.1 time: 0.773164 Feb 17 03:26:54.368739 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 39/65] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:53 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1221 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:54.512612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-8986f3e2-c34f-4661-a556-39549865d30d req-abb5ef47-5fa6-4f94-b9d3-db31ff81980c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d0cd30-d2db-45c4-b0f0-35a3d1397131", "tag": "20bebd7e-f117-4b32-875f-9094449d119c"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:54.515967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:26:54.515967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:26:54.548679 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-8986f3e2-c34f-4661-a556-39549865d30d req-abb5ef47-5fa6-4f94-b9d3-db31ff81980c service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:54.549196 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-8986f3e2-c34f-4661-a556-39549865d30d req-abb5ef47-5fa6-4f94-b9d3-db31ff81980c service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:54.626226 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-8986f3e2-c34f-4661-a556-39549865d30d req-abb5ef47-5fa6-4f94-b9d3-db31ff81980c service nova] Creating event network-changed:20bebd7e-f117-4b32-875f-9094449d119c for instance b1d0cd30-d2db-45c4-b0f0-35a3d1397131 on hv-cinder-75996 Feb 17 03:26:54.628667 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-8986f3e2-c34f-4661-a556-39549865d30d req-abb5ef47-5fa6-4f94-b9d3-db31ff81980c service nova] Acquired lock "compute-rpcapi-router" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:26:54.630626 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bc522fc-dce5-40ef-9dd0-093b97aacb56 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:54.635712 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bc522fc-dce5-40ef-9dd0-093b97aacb56 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:54.637600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bc522fc-dce5-40ef-9dd0-093b97aacb56 None None] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:54.638293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bc522fc-dce5-40ef-9dd0-093b97aacb56 None None] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:54.659884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.compute.rpcapi [None req-7bc522fc-dce5-40ef-9dd0-093b97aacb56 None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 17 03:26:54.661872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bc522fc-dce5-40ef-9dd0-093b97aacb56 None None] Releasing lock "compute-rpcapi-router" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:26:54.726435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7bc522fc-dce5-40ef-9dd0-093b97aacb56 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355862 Feb 17 03:26:54.730396 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 40/66] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:26:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:26:55.101261 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-024e79a6-617a-46d8-8efe-e54a4181328d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'create', calling method: .version_select at 0x7f012f860e18>, body: {"keypair": {"name": "tempest-keypair-1425365291"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:55.149780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-024e79a6-617a-46d8-8efe-e54a4181328d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Getting quotas for project 540aff79a2694839aada97949939da9c. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:26:55.154103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-024e79a6-617a-46d8-8efe-e54a4181328d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Getting quotas for user aa461b9b5c574c16b33c3da000b65f14 and project 540aff79a2694839aada97949939da9c. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:26:55.408526 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-024e79a6-617a-46d8-8efe-e54a4181328d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Getting quotas for project 540aff79a2694839aada97949939da9c. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:26:55.412898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-024e79a6-617a-46d8-8efe-e54a4181328d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Getting quotas for user aa461b9b5c574c16b33c3da000b65f14 and project 540aff79a2694839aada97949939da9c. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:26:55.429093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-024e79a6-617a-46d8-8efe-e54a4181328d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.696872 Feb 17 03:26:55.429939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 41/67] 10.222.0.46 () {60 vars in 1148 bytes} [Wed Feb 17 03:26:54 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:55.436736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d9f23c09-67aa-4f8d-a4c2-5cebd6e359d4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:55.437539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d9f23c09-67aa-4f8d-a4c2-5cebd6e359d4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:55.447030 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d9f23c09-67aa-4f8d-a4c2-5cebd6e359d4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:55.447556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d9f23c09-67aa-4f8d-a4c2-5cebd6e359d4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:55.448425 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d9f23c09-67aa-4f8d-a4c2-5cebd6e359d4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:55.448987 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d9f23c09-67aa-4f8d-a4c2-5cebd6e359d4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:55.541221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c03ee324-e337-419d-bc71-951fec52583a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:55.553992 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c03ee324-e337-419d-bc71-951fec52583a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1317 microversion: 2.1 time: 2.468743 Feb 17 03:26:55.558858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 27/68] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:53 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1317 bytes in 2474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:55.573930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-128638049", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7c8931b5-d986-48a9-8797-db4c2b0cb489"}]}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:55.701160 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] validate_networks() for [('7c8931b5-d986-48a9-8797-db4c2b0cb489', None, None, None)] {{(pid=98183) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:26:56.516792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d9f23c09-67aa-4f8d-a4c2-5cebd6e359d4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:56.536424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d9f23c09-67aa-4f8d-a4c2-5cebd6e359d4 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1315 microversion: 2.1 time: 1.105478 Feb 17 03:26:56.537036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 42/69] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:55 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1315 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:56.950159 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-a6043de5-a931-4cda-89d1-43a75823f612 req-ca57177d-8895-40c0-81bf-4403336a0c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3", "name": "network-vif-plugged", "status": "completed", "tag": "720dde26-b646-463c-981e-62d7f5b221b3"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:26:56.952093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:26:56.952093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:26:56.969766 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-a6043de5-a931-4cda-89d1-43a75823f612 req-ca57177d-8895-40c0-81bf-4403336a0c60 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:56.975587 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-a6043de5-a931-4cda-89d1-43a75823f612 req-ca57177d-8895-40c0-81bf-4403336a0c60 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:57.023546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-a6043de5-a931-4cda-89d1-43a75823f612 req-ca57177d-8895-40c0-81bf-4403336a0c60 service nova] Creating event network-vif-plugged:720dde26-b646-463c-981e-62d7f5b221b3 for instance ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 on hv-cinder-75996 Feb 17 03:26:57.031993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-a6043de5-a931-4cda-89d1-43a75823f612 req-ca57177d-8895-40c0-81bf-4403336a0c60 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.483746 Feb 17 03:26:57.034303 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 43/70] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:26:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:26:57.039829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e0627633-a3f5-4c23-83cc-3cb6a975a705 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:57.040595 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e0627633-a3f5-4c23-83cc-3cb6a975a705 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:57.065951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0627633-a3f5-4c23-83cc-3cb6a975a705 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:57.066401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0627633-a3f5-4c23-83cc-3cb6a975a705 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:57.067267 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0627633-a3f5-4c23-83cc-3cb6a975a705 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:57.067787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0627633-a3f5-4c23-83cc-3cb6a975a705 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:59.588812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e0627633-a3f5-4c23-83cc-3cb6a975a705 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:26:59.594561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Flavor limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:26:59.596404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Image limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:26:59.596404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Flavor pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:26:59.596404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Image pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:26:59.597129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:26:59.600554 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e0627633-a3f5-4c23-83cc-3cb6a975a705 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1317 microversion: 2.1 time: 2.564980 Feb 17 03:26:59.601153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 44/71] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:57 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1317 bytes in 2566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:26:59.615460 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:59.617694 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:59.619808 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:59.620381 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7f929aab-e975-42b0-a0a1-4b6a7f32d1fe tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:26:59.621010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:59.624688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7f929aab-e975-42b0-a0a1-4b6a7f32d1fe tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:26:59.651101 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7f929aab-e975-42b0-a0a1-4b6a7f32d1fe tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:59.652103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7f929aab-e975-42b0-a0a1-4b6a7f32d1fe tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:59.653859 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7f929aab-e975-42b0-a0a1-4b6a7f32d1fe tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:59.654669 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7f929aab-e975-42b0-a0a1-4b6a7f32d1fe tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:59.677201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Getting quotas for project 11a5692210d54de3b217536dd49aa377. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:26:59.689070 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Getting quotas for user 6816ad0cd5f846ef8a759f5a2ded11c2 and project 11a5692210d54de3b217536dd49aa377. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:26:59.710678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Going to run 1 instances... {{(pid=98183) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:26:59.713414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:26:59.796084 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c791410b-4ccb-453b-b7fc-8358f55bdb85 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.234966 Feb 17 03:26:59.796855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 28/72] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:26:55 2021] POST /compute/v2.1/servers => generated 383 bytes in 4237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:26:59.804007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-765616428", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb8f45f6-f6e6-4160-8b4b-ea43f62275bd"}], "security_groups": [{"name": "tempest-securitygroup--536053479"}], "key_name": "tempest-keypair-1522223405", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:00.788194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] validate_networks() for [('cb8f45f6-f6e6-4160-8b4b-ea43f62275bd', None, None, None)] {{(pid=98183) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:27:00.853130 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7f929aab-e975-42b0-a0a1-4b6a7f32d1fe tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:00.870318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7f929aab-e975-42b0-a0a1-4b6a7f32d1fe tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1315 microversion: 2.1 time: 1.261390 Feb 17 03:27:00.883492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 45/73] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:26:59 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1315 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:00.892050 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-50f633a3-9d7f-4068-96d2-13d8968877c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:00.893041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-50f633a3-9d7f-4068-96d2-13d8968877c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:00.905668 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50f633a3-9d7f-4068-96d2-13d8968877c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:00.906379 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50f633a3-9d7f-4068-96d2-13d8968877c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:00.907429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50f633a3-9d7f-4068-96d2-13d8968877c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:00.908429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50f633a3-9d7f-4068-96d2-13d8968877c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:01.587935 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-50f633a3-9d7f-4068-96d2-13d8968877c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:01.614794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-50f633a3-9d7f-4068-96d2-13d8968877c9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1217 microversion: 2.1 time: 0.729634 Feb 17 03:27:01.617892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 46/74] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:00 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1217 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:01.634333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e7a3732b-6e1f-4939-bc1e-ab96307e3210 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:01.634998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e7a3732b-6e1f-4939-bc1e-ab96307e3210 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:01.645197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e7a3732b-6e1f-4939-bc1e-ab96307e3210 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:01.645780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e7a3732b-6e1f-4939-bc1e-ab96307e3210 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:01.646702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e7a3732b-6e1f-4939-bc1e-ab96307e3210 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:01.647248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e7a3732b-6e1f-4939-bc1e-ab96307e3210 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:02.354906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e7a3732b-6e1f-4939-bc1e-ab96307e3210 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:02.375421 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e7a3732b-6e1f-4939-bc1e-ab96307e3210 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1317 microversion: 2.1 time: 0.754686 Feb 17 03:27:02.378042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 47/75] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:01 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1317 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:02.387546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-511633948", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aaca52fc-20e8-4f1e-a4a1-2b3bb58459da"}], "security_groups": [{"name": "tempest-securitygroup--1097301603"}], "key_name": "tempest-keypair-1425365291", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:02.985653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] validate_networks() for [('aaca52fc-20e8-4f1e-a4a1-2b3bb58459da', None, None, None)] {{(pid=98184) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:27:03.676298 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Flavor limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:27:03.677801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Image limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:27:03.678515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Flavor pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:27:03.679218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Image pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:27:03.679940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:27:03.693941 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:03.694453 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:03.695341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:03.696544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:03.719427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Getting quotas for project 7d8b1f2f62fe46bd86f2158ff4c88376. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:03.723414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Getting quotas for user 4b5d48272f134d44a615b37af1bbbed6 and project 7d8b1f2f62fe46bd86f2158ff4c88376. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:03.735722 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Going to run 1 instances... {{(pid=98183) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:27:03.738631 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:27:03.810193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e1396b61-6311-4ea9-8b45-def54208c8c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.011427 Feb 17 03:27:03.811939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 29/76] 10.222.0.46 () {62 vars in 1178 bytes} [Wed Feb 17 03:26:59 2021] POST /compute/v2.1/servers => generated 401 bytes in 4014 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 17 03:27:03.825175 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-ae5bb65b-c61e-4698-9945-1c260f6ed83c req-1fee2ace-9150-4076-8279-b18a8f2011f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d0cd30-d2db-45c4-b0f0-35a3d1397131", "name": "network-vif-plugged", "status": "completed", "tag": "20bebd7e-f117-4b32-875f-9094449d119c"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:03.827338 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:03.827338 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:03.996305 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-ae5bb65b-c61e-4698-9945-1c260f6ed83c req-1fee2ace-9150-4076-8279-b18a8f2011f3 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:03.996799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-ae5bb65b-c61e-4698-9945-1c260f6ed83c req-1fee2ace-9150-4076-8279-b18a8f2011f3 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:04.020575 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-ae5bb65b-c61e-4698-9945-1c260f6ed83c req-1fee2ace-9150-4076-8279-b18a8f2011f3 service nova] Creating event network-vif-plugged:20bebd7e-f117-4b32-875f-9094449d119c for instance b1d0cd30-d2db-45c4-b0f0-35a3d1397131 on hv-cinder-75996 Feb 17 03:27:04.026071 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-ae5bb65b-c61e-4698-9945-1c260f6ed83c req-1fee2ace-9150-4076-8279-b18a8f2011f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205857 Feb 17 03:27:04.026802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 30/77] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:04.033887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9ffe3114-d5b5-486e-8918-a4c76dc52a88 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:04.034733 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9ffe3114-d5b5-486e-8918-a4c76dc52a88 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:04.051028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ffe3114-d5b5-486e-8918-a4c76dc52a88 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:04.051594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ffe3114-d5b5-486e-8918-a4c76dc52a88 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:04.052451 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ffe3114-d5b5-486e-8918-a4c76dc52a88 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:04.052949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ffe3114-d5b5-486e-8918-a4c76dc52a88 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:05.685424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9ffe3114-d5b5-486e-8918-a4c76dc52a88 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:05.696404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9ffe3114-d5b5-486e-8918-a4c76dc52a88 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1501 microversion: 2.1 time: 1.668435 Feb 17 03:27:05.696997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 31/78] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:04 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1501 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:05.719404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-07555c44-bfc2-40ac-b913-119db1c2190b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:05.721287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-07555c44-bfc2-40ac-b913-119db1c2190b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:05.735844 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-07555c44-bfc2-40ac-b913-119db1c2190b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:05.736787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-07555c44-bfc2-40ac-b913-119db1c2190b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:05.737730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-07555c44-bfc2-40ac-b913-119db1c2190b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:05.738308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-07555c44-bfc2-40ac-b913-119db1c2190b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:05.890233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Flavor limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:27:05.890682 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Image limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:27:05.891208 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Flavor pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:27:05.891684 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Image pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:27:05.892135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:27:05.922885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:05.923684 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:05.924933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:05.925570 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:05.970789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Getting quotas for project 540aff79a2694839aada97949939da9c. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:05.994412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Getting quotas for user aa461b9b5c574c16b33c3da000b65f14 and project 540aff79a2694839aada97949939da9c. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:06.025466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Going to run 1 instances... {{(pid=98184) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:27:06.028485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:27:06.105939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ace1d821-01e8-420f-80c9-ba1f07c53b7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.725524 Feb 17 03:27:06.106973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 48/79] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:27:02 2021] POST /compute/v2.1/servers => generated 402 bytes in 3729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:27:06.118669 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4e614303-eb09-4a6c-a18b-9dcf3c663cf4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:06.120138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4e614303-eb09-4a6c-a18b-9dcf3c663cf4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:06.137138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e614303-eb09-4a6c-a18b-9dcf3c663cf4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:06.140009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e614303-eb09-4a6c-a18b-9dcf3c663cf4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:06.142719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e614303-eb09-4a6c-a18b-9dcf3c663cf4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:06.143427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e614303-eb09-4a6c-a18b-9dcf3c663cf4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:07.382399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-07555c44-bfc2-40ac-b913-119db1c2190b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:07.397204 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-07555c44-bfc2-40ac-b913-119db1c2190b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1321 microversion: 2.1 time: 1.698041 Feb 17 03:27:07.401290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 32/80] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:05 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1321 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:07.419700 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9adee97c-5aab-4b33-8069-309fc60e206a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:07.420980 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9adee97c-5aab-4b33-8069-309fc60e206a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:07.444028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9adee97c-5aab-4b33-8069-309fc60e206a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:07.444519 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9adee97c-5aab-4b33-8069-309fc60e206a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:07.445365 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9adee97c-5aab-4b33-8069-309fc60e206a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:07.445843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9adee97c-5aab-4b33-8069-309fc60e206a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:07.712972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4e614303-eb09-4a6c-a18b-9dcf3c663cf4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:07.747283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4e614303-eb09-4a6c-a18b-9dcf3c663cf4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1317 microversion: 2.1 time: 1.633997 Feb 17 03:27:07.753859 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 49/81] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:06 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1317 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:07.765249 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3b5ad3a4-29d8-449f-9f48-17275ffc9cfc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:07.767382 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3b5ad3a4-29d8-449f-9f48-17275ffc9cfc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:07.790621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b5ad3a4-29d8-449f-9f48-17275ffc9cfc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:07.794350 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b5ad3a4-29d8-449f-9f48-17275ffc9cfc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:07.796685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b5ad3a4-29d8-449f-9f48-17275ffc9cfc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:07.798813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b5ad3a4-29d8-449f-9f48-17275ffc9cfc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:07.865659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9adee97c-5aab-4b33-8069-309fc60e206a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:07.880021 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9adee97c-5aab-4b33-8069-309fc60e206a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:07.881571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9adee97c-5aab-4b33-8069-309fc60e206a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:07.882692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9adee97c-5aab-4b33-8069-309fc60e206a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1339 microversion: 2.20 time: 0.469663 Feb 17 03:27:07.883524 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 33/82] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:27:07 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1339 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:27:07.919416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-e8eb68ae-b62b-4cda-bbaa-47c42de5a4b3 req-bbaaefb7-e9ef-47f5-ae4c-2cf3f0626bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec09d11-1456-48e6-9b4a-cbb0c7775f78", "tag": "c9ca62c0-10ef-4ead-9a9e-530134fbf939"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:07.927115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:07.927115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:07.953071 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-e8eb68ae-b62b-4cda-bbaa-47c42de5a4b3 req-bbaaefb7-e9ef-47f5-ae4c-2cf3f0626bd7 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:07.953587 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-e8eb68ae-b62b-4cda-bbaa-47c42de5a4b3 req-bbaaefb7-e9ef-47f5-ae4c-2cf3f0626bd7 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:07.996906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-e8eb68ae-b62b-4cda-bbaa-47c42de5a4b3 req-bbaaefb7-e9ef-47f5-ae4c-2cf3f0626bd7 service nova] Creating event network-changed:c9ca62c0-10ef-4ead-9a9e-530134fbf939 for instance 6ec09d11-1456-48e6-9b4a-cbb0c7775f78 on hv-cinder-75996 Feb 17 03:27:08.008282 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-e8eb68ae-b62b-4cda-bbaa-47c42de5a4b3 req-bbaaefb7-e9ef-47f5-ae4c-2cf3f0626bd7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094741 Feb 17 03:27:08.010918 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 34/83] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:08.024556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-16c3ede1-7f82-4216-ab3d-95ee1161638f req-14a47250-b3fc-4e9f-a2ef-21ec93489a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa28415b-6a4c-429a-b1cc-b694089a6af8", "tag": "d44d5eb4-7819-4ef2-ab77-782ff0c9f159"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:08.029401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:08.029401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:08.046286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-16c3ede1-7f82-4216-ab3d-95ee1161638f req-14a47250-b3fc-4e9f-a2ef-21ec93489a1a service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:08.056271 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-16c3ede1-7f82-4216-ab3d-95ee1161638f req-14a47250-b3fc-4e9f-a2ef-21ec93489a1a service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:08.094605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-16c3ede1-7f82-4216-ab3d-95ee1161638f req-14a47250-b3fc-4e9f-a2ef-21ec93489a1a service nova] Creating event network-changed:d44d5eb4-7819-4ef2-ab77-782ff0c9f159 for instance fa28415b-6a4c-429a-b1cc-b694089a6af8 on hv-cinder-75996 Feb 17 03:27:08.106216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-16c3ede1-7f82-4216-ab3d-95ee1161638f req-14a47250-b3fc-4e9f-a2ef-21ec93489a1a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092085 Feb 17 03:27:08.106872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 35/84] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:08.121993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e123a0c0-441a-4fea-8f43-312a90d478c8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76fbbb55-983d-46f3-b70c-dce7e38ead37"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:08.124312 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e123a0c0-441a-4fea-8f43-312a90d478c8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:08.143519 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e123a0c0-441a-4fea-8f43-312a90d478c8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:08.143989 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e123a0c0-441a-4fea-8f43-312a90d478c8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:08.147763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e123a0c0-441a-4fea-8f43-312a90d478c8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:08.148297 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e123a0c0-441a-4fea-8f43-312a90d478c8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:08.660845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3b5ad3a4-29d8-449f-9f48-17275ffc9cfc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:08.685152 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3b5ad3a4-29d8-449f-9f48-17275ffc9cfc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1289 microversion: 2.1 time: 0.929764 Feb 17 03:27:08.686369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 50/85] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:07 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1289 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:08.730921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f6b9ed9b-92ff-4cb8-9fe2-9edb5ef913fc tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:08.732113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f6b9ed9b-92ff-4cb8-9fe2-9edb5ef913fc tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:08.747820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f6b9ed9b-92ff-4cb8-9fe2-9edb5ef913fc tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:08.749360 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f6b9ed9b-92ff-4cb8-9fe2-9edb5ef913fc tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:08.750864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f6b9ed9b-92ff-4cb8-9fe2-9edb5ef913fc tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:08.751573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f6b9ed9b-92ff-4cb8-9fe2-9edb5ef913fc tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:09.042918 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e123a0c0-441a-4fea-8f43-312a90d478c8 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "POST /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.933458 Feb 17 03:27:09.044662 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 36/86] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:27:08 2021] POST /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3/os-volume_attachments => generated 194 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:09.072644 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c5ffc02a-a76d-420a-a66f-e821b2cf21d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:09.077443 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c5ffc02a-a76d-420a-a66f-e821b2cf21d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:09.086024 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c5ffc02a-a76d-420a-a66f-e821b2cf21d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:09.086825 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c5ffc02a-a76d-420a-a66f-e821b2cf21d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:09.089391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c5ffc02a-a76d-420a-a66f-e821b2cf21d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:09.090106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c5ffc02a-a76d-420a-a66f-e821b2cf21d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:10.012573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f6b9ed9b-92ff-4cb8-9fe2-9edb5ef913fc tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:10.023351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f6b9ed9b-92ff-4cb8-9fe2-9edb5ef913fc tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1321 microversion: 2.1 time: 1.306427 Feb 17 03:27:10.030436 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 51/87] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:08 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1321 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:10.036256 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a9cf766f-3e1f-4525-b24f-43024e7993ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:10.036912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a9cf766f-3e1f-4525-b24f-43024e7993ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:10.050283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a9cf766f-3e1f-4525-b24f-43024e7993ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:10.050283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a9cf766f-3e1f-4525-b24f-43024e7993ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:10.050283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a9cf766f-3e1f-4525-b24f-43024e7993ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:10.050283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a9cf766f-3e1f-4525-b24f-43024e7993ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:10.316832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c5ffc02a-a76d-420a-a66f-e821b2cf21d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:10.329426 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c5ffc02a-a76d-420a-a66f-e821b2cf21d6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1507 microversion: 2.1 time: 1.283082 Feb 17 03:27:10.330026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 37/88] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:09 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1507 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:10.351451 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d277e116-2b85-4c8a-b43a-df352d2e2d3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:10.356066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d277e116-2b85-4c8a-b43a-df352d2e2d3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:10.378894 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d277e116-2b85-4c8a-b43a-df352d2e2d3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:10.379416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d277e116-2b85-4c8a-b43a-df352d2e2d3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:10.380300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d277e116-2b85-4c8a-b43a-df352d2e2d3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:10.380790 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d277e116-2b85-4c8a-b43a-df352d2e2d3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:10.582939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d277e116-2b85-4c8a-b43a-df352d2e2d3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:10.596038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d277e116-2b85-4c8a-b43a-df352d2e2d3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1295 microversion: 2.1 time: 0.264552 Feb 17 03:27:10.597336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 38/89] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:10 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1295 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:10.919886 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a9cf766f-3e1f-4525-b24f-43024e7993ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:10.930091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a9cf766f-3e1f-4525-b24f-43024e7993ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:10.938644 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a9cf766f-3e1f-4525-b24f-43024e7993ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:10.939876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a9cf766f-3e1f-4525-b24f-43024e7993ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1406 microversion: 2.20 time: 0.908344 Feb 17 03:27:10.940683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 52/90] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:27:10 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1406 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:27:11.041227 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-224f62d6-b7a2-40c3-80ac-de5549f6e8fd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:11.041903 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-224f62d6-b7a2-40c3-80ac-de5549f6e8fd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:11.061939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-224f62d6-b7a2-40c3-80ac-de5549f6e8fd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:11.065080 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-224f62d6-b7a2-40c3-80ac-de5549f6e8fd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:11.066050 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-224f62d6-b7a2-40c3-80ac-de5549f6e8fd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:11.066555 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-224f62d6-b7a2-40c3-80ac-de5549f6e8fd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:11.614784 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e86168d9-47ab-42b9-92f2-48f85796de49 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:11.615417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e86168d9-47ab-42b9-92f2-48f85796de49 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:11.637257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e86168d9-47ab-42b9-92f2-48f85796de49 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:11.642104 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e86168d9-47ab-42b9-92f2-48f85796de49 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:11.643265 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e86168d9-47ab-42b9-92f2-48f85796de49 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:11.643865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e86168d9-47ab-42b9-92f2-48f85796de49 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:12.118016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e86168d9-47ab-42b9-92f2-48f85796de49 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:12.128851 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e86168d9-47ab-42b9-92f2-48f85796de49 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1295 microversion: 2.1 time: 0.517931 Feb 17 03:27:12.129466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 53/91] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:11 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1295 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:12.142391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e431428b-bc86-4671-9745-834a8272f265 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:12.143023 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e431428b-bc86-4671-9745-834a8272f265 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:12.159746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e431428b-bc86-4671-9745-834a8272f265 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:12.162105 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e431428b-bc86-4671-9745-834a8272f265 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:12.163087 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e431428b-bc86-4671-9745-834a8272f265 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:12.163581 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e431428b-bc86-4671-9745-834a8272f265 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:12.258173 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-224f62d6-b7a2-40c3-80ac-de5549f6e8fd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:12.292169 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-224f62d6-b7a2-40c3-80ac-de5549f6e8fd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1321 microversion: 2.1 time: 1.254878 Feb 17 03:27:12.293247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 39/92] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:11 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1321 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:12.308753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-ddfa5c51-a706-4d38-92dc-ae5efcdae346 req-cbe69be9-de74-40b9-907b-d74ebe37db8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89d14a3-493e-413a-918e-fd2de544e689", "tag": "8e645981-866a-495c-83c8-d0e1206a99d1"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:12.323930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:12.323930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:12.354821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-ddfa5c51-a706-4d38-92dc-ae5efcdae346 req-cbe69be9-de74-40b9-907b-d74ebe37db8e service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:12.361670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-ddfa5c51-a706-4d38-92dc-ae5efcdae346 req-cbe69be9-de74-40b9-907b-d74ebe37db8e service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:12.406432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-ddfa5c51-a706-4d38-92dc-ae5efcdae346 req-cbe69be9-de74-40b9-907b-d74ebe37db8e service nova] Creating event network-changed:8e645981-866a-495c-83c8-d0e1206a99d1 for instance a89d14a3-493e-413a-918e-fd2de544e689 on hv-cinder-75996 Feb 17 03:27:12.411857 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-ddfa5c51-a706-4d38-92dc-ae5efcdae346 req-cbe69be9-de74-40b9-907b-d74ebe37db8e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117136 Feb 17 03:27:12.412795 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 40/93] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:12.510725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-91e48fe9-0369-4aba-8b46-f6f9a1838e7e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad8c6fb7-59f0-42de-a526-099608a14ad3"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:12.512455 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-91e48fe9-0369-4aba-8b46-f6f9a1838e7e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:12.528867 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91e48fe9-0369-4aba-8b46-f6f9a1838e7e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:12.532442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91e48fe9-0369-4aba-8b46-f6f9a1838e7e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:12.534073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91e48fe9-0369-4aba-8b46-f6f9a1838e7e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:12.538116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91e48fe9-0369-4aba-8b46-f6f9a1838e7e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:12.839212 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e431428b-bc86-4671-9745-834a8272f265 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:12.852319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e431428b-bc86-4671-9745-834a8272f265 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:12.855447 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e431428b-bc86-4671-9745-834a8272f265 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:12.856745 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e431428b-bc86-4671-9745-834a8272f265 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1406 microversion: 2.20 time: 0.722016 Feb 17 03:27:12.858183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 54/94] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:27:12 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1406 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:27:13.112882 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-91e48fe9-0369-4aba-8b46-f6f9a1838e7e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "POST /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.607615 Feb 17 03:27:13.114260 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 41/95] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:27:12 2021] POST /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131/os-volume_attachments => generated 194 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:13.157221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-970ce19b-9265-4779-a94b-d12a1fec79ec tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:13.158477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-970ce19b-9265-4779-a94b-d12a1fec79ec tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:13.169915 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-970ce19b-9265-4779-a94b-d12a1fec79ec tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:13.171446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-970ce19b-9265-4779-a94b-d12a1fec79ec tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:13.172472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-970ce19b-9265-4779-a94b-d12a1fec79ec tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:13.173076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-970ce19b-9265-4779-a94b-d12a1fec79ec tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:13.311601 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0c32499c-1ff6-48a4-ac41-e08754277fac tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:13.312538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0c32499c-1ff6-48a4-ac41-e08754277fac tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:13.339812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c32499c-1ff6-48a4-ac41-e08754277fac tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:13.339812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c32499c-1ff6-48a4-ac41-e08754277fac tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:13.339812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c32499c-1ff6-48a4-ac41-e08754277fac tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:13.339812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c32499c-1ff6-48a4-ac41-e08754277fac tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:14.106643 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0c32499c-1ff6-48a4-ac41-e08754277fac tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:14.120285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0c32499c-1ff6-48a4-ac41-e08754277fac tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1321 microversion: 2.1 time: 0.813813 Feb 17 03:27:14.122854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 42/96] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:13 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1321 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:14.131301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f99ef7bd-a92c-4293-81df-3048f9c7e6ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:14.132374 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f99ef7bd-a92c-4293-81df-3048f9c7e6ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:14.144216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f99ef7bd-a92c-4293-81df-3048f9c7e6ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:14.144950 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f99ef7bd-a92c-4293-81df-3048f9c7e6ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:14.147802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f99ef7bd-a92c-4293-81df-3048f9c7e6ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:14.148448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f99ef7bd-a92c-4293-81df-3048f9c7e6ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:14.173404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-970ce19b-9265-4779-a94b-d12a1fec79ec tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:14.183126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-970ce19b-9265-4779-a94b-d12a1fec79ec tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1363 microversion: 2.1 time: 1.040557 Feb 17 03:27:14.189500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 55/97] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:13 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1363 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:14.741464 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-bfa5ac42-a150-42f3-b276-3e6c43db2491 req-89411418-6c6c-4ff1-9d27-6d99668a1231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa28415b-6a4c-429a-b1cc-b694089a6af8", "name": "network-vif-plugged", "status": "completed", "tag": "d44d5eb4-7819-4ef2-ab77-782ff0c9f159"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:14.744152 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:14.744152 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:14.763430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-bfa5ac42-a150-42f3-b276-3e6c43db2491 req-89411418-6c6c-4ff1-9d27-6d99668a1231 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:14.764776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-bfa5ac42-a150-42f3-b276-3e6c43db2491 req-89411418-6c6c-4ff1-9d27-6d99668a1231 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:14.814768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-bfa5ac42-a150-42f3-b276-3e6c43db2491 req-89411418-6c6c-4ff1-9d27-6d99668a1231 service nova] Creating event network-vif-plugged:d44d5eb4-7819-4ef2-ab77-782ff0c9f159 for instance fa28415b-6a4c-429a-b1cc-b694089a6af8 on hv-cinder-75996 Feb 17 03:27:14.825064 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-bfa5ac42-a150-42f3-b276-3e6c43db2491 req-89411418-6c6c-4ff1-9d27-6d99668a1231 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087755 Feb 17 03:27:14.830792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 56/98] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:27:15.017391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f99ef7bd-a92c-4293-81df-3048f9c7e6ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:15.033153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f99ef7bd-a92c-4293-81df-3048f9c7e6ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:15.034743 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f99ef7bd-a92c-4293-81df-3048f9c7e6ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:15.035903 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f99ef7bd-a92c-4293-81df-3048f9c7e6ed tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1406 microversion: 2.20 time: 0.910062 Feb 17 03:27:15.053230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 43/99] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:27:14 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1406 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:27:15.141856 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-89b874c5-78d0-4f6f-8827-083919aca88b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:15.142803 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-89b874c5-78d0-4f6f-8827-083919aca88b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:15.156129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89b874c5-78d0-4f6f-8827-083919aca88b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:15.158208 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89b874c5-78d0-4f6f-8827-083919aca88b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:15.161123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89b874c5-78d0-4f6f-8827-083919aca88b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:15.163145 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89b874c5-78d0-4f6f-8827-083919aca88b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:15.206630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-035135a9-5064-409e-9f9b-cf8aa9bb5196 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:15.207964 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-035135a9-5064-409e-9f9b-cf8aa9bb5196 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:15.229185 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-035135a9-5064-409e-9f9b-cf8aa9bb5196 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:15.229978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-035135a9-5064-409e-9f9b-cf8aa9bb5196 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:15.230980 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-035135a9-5064-409e-9f9b-cf8aa9bb5196 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:15.232158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-035135a9-5064-409e-9f9b-cf8aa9bb5196 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:16.181109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-89b874c5-78d0-4f6f-8827-083919aca88b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:16.186757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-035135a9-5064-409e-9f9b-cf8aa9bb5196 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:16.199343 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-035135a9-5064-409e-9f9b-cf8aa9bb5196 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1363 microversion: 2.1 time: 0.996684 Feb 17 03:27:16.210143 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-89b874c5-78d0-4f6f-8827-083919aca88b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1321 microversion: 2.1 time: 1.073100 Feb 17 03:27:16.214895 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 57/100] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:15 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1321 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:16.218276 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 44/101] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:15 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1363 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:16.223804 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3aa32aa3-27a3-4a94-ba77-9bf91afd8a13 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:16.243037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3aa32aa3-27a3-4a94-ba77-9bf91afd8a13 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:16.254671 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3aa32aa3-27a3-4a94-ba77-9bf91afd8a13 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:16.255687 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3aa32aa3-27a3-4a94-ba77-9bf91afd8a13 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:16.256770 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3aa32aa3-27a3-4a94-ba77-9bf91afd8a13 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:16.257624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3aa32aa3-27a3-4a94-ba77-9bf91afd8a13 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:16.273995 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-12d10f7e-9b85-4d30-bfc8-dd49f26a1ff6 req-e64aa160-9ab3-496c-a197-e67a9923aa1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415389d3-caaf-4b28-9090-426e4fe11633", "tag": "2de00b31-a873-47bd-8a1b-654da9855749"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:16.276361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:16.276361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:16.292042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-12d10f7e-9b85-4d30-bfc8-dd49f26a1ff6 req-e64aa160-9ab3-496c-a197-e67a9923aa1a service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:16.292734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-12d10f7e-9b85-4d30-bfc8-dd49f26a1ff6 req-e64aa160-9ab3-496c-a197-e67a9923aa1a service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:16.354134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-12d10f7e-9b85-4d30-bfc8-dd49f26a1ff6 req-e64aa160-9ab3-496c-a197-e67a9923aa1a service nova] Creating event network-changed:2de00b31-a873-47bd-8a1b-654da9855749 for instance 415389d3-caaf-4b28-9090-426e4fe11633 on hv-cinder-75996 Feb 17 03:27:16.361134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-12d10f7e-9b85-4d30-bfc8-dd49f26a1ff6 req-e64aa160-9ab3-496c-a197-e67a9923aa1a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091081 Feb 17 03:27:16.362216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 45/102] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:27:16.722298 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3aa32aa3-27a3-4a94-ba77-9bf91afd8a13 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:16.753858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3aa32aa3-27a3-4a94-ba77-9bf91afd8a13 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:16.755930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3aa32aa3-27a3-4a94-ba77-9bf91afd8a13 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:16.767455 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3aa32aa3-27a3-4a94-ba77-9bf91afd8a13 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1406 microversion: 2.20 time: 0.551149 Feb 17 03:27:16.768592 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 58/103] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:27:16 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1406 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:27:16.907080 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-5443923a-cabc-47d9-9109-181fe060a181 req-305532e5-3e71-4b28-b48d-5eb1074ea9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec09d11-1456-48e6-9b4a-cbb0c7775f78", "name": "network-vif-plugged", "status": "completed", "tag": "c9ca62c0-10ef-4ead-9a9e-530134fbf939"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:16.908944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:16.908944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:16.929463 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-5443923a-cabc-47d9-9109-181fe060a181 req-305532e5-3e71-4b28-b48d-5eb1074ea9d2 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:16.930163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-5443923a-cabc-47d9-9109-181fe060a181 req-305532e5-3e71-4b28-b48d-5eb1074ea9d2 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:16.962880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-5443923a-cabc-47d9-9109-181fe060a181 req-305532e5-3e71-4b28-b48d-5eb1074ea9d2 service nova] Creating event network-vif-plugged:c9ca62c0-10ef-4ead-9a9e-530134fbf939 for instance 6ec09d11-1456-48e6-9b4a-cbb0c7775f78 on hv-cinder-75996 Feb 17 03:27:16.974821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-5443923a-cabc-47d9-9109-181fe060a181 req-305532e5-3e71-4b28-b48d-5eb1074ea9d2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072269 Feb 17 03:27:16.978901 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 46/104] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:17.247166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e60b973c-19eb-4be1-bbe0-da882dddea0b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:17.247863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e60b973c-19eb-4be1-bbe0-da882dddea0b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:17.254595 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f2c7d0ce-ad40-428f-a0e8-8a7f7dee3746 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:17.255372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f2c7d0ce-ad40-428f-a0e8-8a7f7dee3746 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:17.273982 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f2c7d0ce-ad40-428f-a0e8-8a7f7dee3746 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:17.277234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f2c7d0ce-ad40-428f-a0e8-8a7f7dee3746 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:17.278453 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f2c7d0ce-ad40-428f-a0e8-8a7f7dee3746 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:17.279233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f2c7d0ce-ad40-428f-a0e8-8a7f7dee3746 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:17.286690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e60b973c-19eb-4be1-bbe0-da882dddea0b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:17.288107 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e60b973c-19eb-4be1-bbe0-da882dddea0b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:17.288975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e60b973c-19eb-4be1-bbe0-da882dddea0b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:17.295820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e60b973c-19eb-4be1-bbe0-da882dddea0b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:17.864887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f2c7d0ce-ad40-428f-a0e8-8a7f7dee3746 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:17.877495 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f2c7d0ce-ad40-428f-a0e8-8a7f7dee3746 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1321 microversion: 2.1 time: 0.636448 Feb 17 03:27:17.878130 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 47/105] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:17 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1321 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:17.892009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5f598543-f74e-473c-a350-7d93962eb0fc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:17.892683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5f598543-f74e-473c-a350-7d93962eb0fc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:17.902031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5f598543-f74e-473c-a350-7d93962eb0fc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:17.902543 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5f598543-f74e-473c-a350-7d93962eb0fc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:17.903716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5f598543-f74e-473c-a350-7d93962eb0fc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:17.904218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5f598543-f74e-473c-a350-7d93962eb0fc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:17.975352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e60b973c-19eb-4be1-bbe0-da882dddea0b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:17.985925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e60b973c-19eb-4be1-bbe0-da882dddea0b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1363 microversion: 2.1 time: 0.742829 Feb 17 03:27:17.986724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 59/106] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:17 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1363 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:18.178519 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5f598543-f74e-473c-a350-7d93962eb0fc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:18.190984 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5f598543-f74e-473c-a350-7d93962eb0fc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:18.193118 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5f598543-f74e-473c-a350-7d93962eb0fc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:18.194332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5f598543-f74e-473c-a350-7d93962eb0fc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1406 microversion: 2.20 time: 0.315176 Feb 17 03:27:18.194881 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 48/107] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:27:17 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:27:18.895324 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-da113243-fd43-4bf9-bf7f-c4f628994bb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:18.896019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-da113243-fd43-4bf9-bf7f-c4f628994bb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:18.903825 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-da113243-fd43-4bf9-bf7f-c4f628994bb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:18.904915 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-da113243-fd43-4bf9-bf7f-c4f628994bb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:18.905760 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-da113243-fd43-4bf9-bf7f-c4f628994bb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:18.906255 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-da113243-fd43-4bf9-bf7f-c4f628994bb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:18.938649 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c1168efa-c755-456d-a9bc-b8be24d960ae tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:18.939471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c1168efa-c755-456d-a9bc-b8be24d960ae tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:18.948823 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c1168efa-c755-456d-a9bc-b8be24d960ae tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:18.949692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c1168efa-c755-456d-a9bc-b8be24d960ae tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:18.950742 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c1168efa-c755-456d-a9bc-b8be24d960ae tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:18.952004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c1168efa-c755-456d-a9bc-b8be24d960ae tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:19.023556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c1168efa-c755-456d-a9bc-b8be24d960ae tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Going to try to terminate instance {{(pid=98183) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:27:19.147696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-da113243-fd43-4bf9-bf7f-c4f628994bb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:19.164733 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c1168efa-c755-456d-a9bc-b8be24d960ae tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 204 len: 0 microversion: 2.1 time: 0.229899 Feb 17 03:27:19.167932 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-da113243-fd43-4bf9-bf7f-c4f628994bb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1515 microversion: 2.1 time: 0.276855 Feb 17 03:27:19.169071 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 49/108] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:27:18 2021] DELETE /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:27:19.181011 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 60/109] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:18 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1515 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:19.184331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7461d8d5-5e83-4f53-83c2-d4e184193ec3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:19.186494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7461d8d5-5e83-4f53-83c2-d4e184193ec3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:19.187341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a46ddd57-a3b2-4dac-88ed-fe2bbc17962c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:19.188280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a46ddd57-a3b2-4dac-88ed-fe2bbc17962c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:19.198067 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a46ddd57-a3b2-4dac-88ed-fe2bbc17962c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:19.198763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a46ddd57-a3b2-4dac-88ed-fe2bbc17962c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:19.199821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a46ddd57-a3b2-4dac-88ed-fe2bbc17962c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:19.200496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a46ddd57-a3b2-4dac-88ed-fe2bbc17962c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:19.203932 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7461d8d5-5e83-4f53-83c2-d4e184193ec3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:19.204579 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7461d8d5-5e83-4f53-83c2-d4e184193ec3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:19.205429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7461d8d5-5e83-4f53-83c2-d4e184193ec3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:19.205920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7461d8d5-5e83-4f53-83c2-d4e184193ec3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:19.610093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7461d8d5-5e83-4f53-83c2-d4e184193ec3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:19.626399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7461d8d5-5e83-4f53-83c2-d4e184193ec3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1363 microversion: 2.1 time: 0.455944 Feb 17 03:27:19.627124 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 50/110] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:19 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1363 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:19.634490 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2719903a-e733-4211-8f49-ee799427b43f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:19.636549 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2719903a-e733-4211-8f49-ee799427b43f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:19.655917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2719903a-e733-4211-8f49-ee799427b43f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:19.656431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2719903a-e733-4211-8f49-ee799427b43f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:19.657391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2719903a-e733-4211-8f49-ee799427b43f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:19.657751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2719903a-e733-4211-8f49-ee799427b43f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:19.669188 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a46ddd57-a3b2-4dac-88ed-fe2bbc17962c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:19.679855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a46ddd57-a3b2-4dac-88ed-fe2bbc17962c tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1553 microversion: 2.1 time: 0.497441 Feb 17 03:27:19.680469 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 61/111] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:19 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1553 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:19.709066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-754acf80-e3a0-4038-ba84-85817d39d231 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:19.709724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-754acf80-e3a0-4038-ba84-85817d39d231 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:19.721024 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-754acf80-e3a0-4038-ba84-85817d39d231 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:19.722084 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-754acf80-e3a0-4038-ba84-85817d39d231 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:19.723225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-754acf80-e3a0-4038-ba84-85817d39d231 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:19.724001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-754acf80-e3a0-4038-ba84-85817d39d231 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:19.830143 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-2719903a-e733-4211-8f49-ee799427b43f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lazy-loading 'flavor' on Instance uuid fa28415b-6a4c-429a-b1cc-b694089a6af8 {{(pid=98183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:27:20.156726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2719903a-e733-4211-8f49-ee799427b43f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "POST /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8/action" status: 200 len: 32 microversion: 2.1 time: 0.528089 Feb 17 03:27:20.157811 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 51/112] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:19 2021] POST /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8/action => generated 32 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:27:20.166230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-754acf80-e3a0-4038-ba84-85817d39d231 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:20.170696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-aeb73147-a08d-4fdf-b5fc-b5291f952272 req-d2ee9b7d-f3a4-4825-88d5-b51de1633849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89d14a3-493e-413a-918e-fd2de544e689", "name": "network-vif-plugged", "status": "completed", "tag": "8e645981-866a-495c-83c8-d0e1206a99d1"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:20.172943 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:20.172943 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:20.177068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-754acf80-e3a0-4038-ba84-85817d39d231 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:20.178866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-754acf80-e3a0-4038-ba84-85817d39d231 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:20.179970 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-754acf80-e3a0-4038-ba84-85817d39d231 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1406 microversion: 2.20 time: 0.486404 Feb 17 03:27:20.180572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 62/113] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:27:19 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1406 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:27:20.184466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-aeb73147-a08d-4fdf-b5fc-b5291f952272 req-d2ee9b7d-f3a4-4825-88d5-b51de1633849 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:20.185308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-aeb73147-a08d-4fdf-b5fc-b5291f952272 req-d2ee9b7d-f3a4-4825-88d5-b51de1633849 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:20.187410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-db10ca6c-debd-42e6-b8b8-5d7bc65563e7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:20.188638 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-db10ca6c-debd-42e6-b8b8-5d7bc65563e7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:20.197674 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db10ca6c-debd-42e6-b8b8-5d7bc65563e7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:20.206514 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-aeb73147-a08d-4fdf-b5fc-b5291f952272 req-d2ee9b7d-f3a4-4825-88d5-b51de1633849 service nova] Creating event network-vif-plugged:8e645981-866a-495c-83c8-d0e1206a99d1 for instance a89d14a3-493e-413a-918e-fd2de544e689 on hv-cinder-75996 Feb 17 03:27:20.210360 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db10ca6c-debd-42e6-b8b8-5d7bc65563e7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:20.211266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db10ca6c-debd-42e6-b8b8-5d7bc65563e7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:20.211802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db10ca6c-debd-42e6-b8b8-5d7bc65563e7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:20.212561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-aeb73147-a08d-4fdf-b5fc-b5291f952272 req-d2ee9b7d-f3a4-4825-88d5-b51de1633849 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048600 Feb 17 03:27:20.213685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 52/114] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:20.453102 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-db10ca6c-debd-42e6-b8b8-5d7bc65563e7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:20.462939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-db10ca6c-debd-42e6-b8b8-5d7bc65563e7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.281014 Feb 17 03:27:20.463586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 63/115] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:20 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:20.646505 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d246dde7-67c0-4b9a-bcba-f550528f3a33 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:20.647268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d246dde7-67c0-4b9a-bcba-f550528f3a33 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:20.662371 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d246dde7-67c0-4b9a-bcba-f550528f3a33 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:20.663037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d246dde7-67c0-4b9a-bcba-f550528f3a33 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:20.664266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d246dde7-67c0-4b9a-bcba-f550528f3a33 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:20.664887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d246dde7-67c0-4b9a-bcba-f550528f3a33 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:20.698460 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d216afe5-e78e-433f-8587-5cf84929d423 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:20.699575 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d216afe5-e78e-433f-8587-5cf84929d423 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:20.708433 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d216afe5-e78e-433f-8587-5cf84929d423 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:20.709172 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d216afe5-e78e-433f-8587-5cf84929d423 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:20.710217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d216afe5-e78e-433f-8587-5cf84929d423 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:20.710957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d216afe5-e78e-433f-8587-5cf84929d423 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:20.994551 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d246dde7-67c0-4b9a-bcba-f550528f3a33 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:21.002135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d216afe5-e78e-433f-8587-5cf84929d423 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:21.004100 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d246dde7-67c0-4b9a-bcba-f550528f3a33 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1363 microversion: 2.1 time: 0.363076 Feb 17 03:27:21.004694 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 53/116] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:20 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:21.012416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d216afe5-e78e-433f-8587-5cf84929d423 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1553 microversion: 2.1 time: 0.317974 Feb 17 03:27:21.013223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 64/117] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:20 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1553 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:21.211549 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0a7e835b-ff11-431e-b8f2-11ad47f91cc8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:21.212277 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0a7e835b-ff11-431e-b8f2-11ad47f91cc8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:21.229158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a7e835b-ff11-431e-b8f2-11ad47f91cc8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:21.229922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a7e835b-ff11-431e-b8f2-11ad47f91cc8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:21.230916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a7e835b-ff11-431e-b8f2-11ad47f91cc8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:21.231737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a7e835b-ff11-431e-b8f2-11ad47f91cc8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:21.481815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1193a198-2249-47b0-8fea-9fb84209123d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:21.482824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1193a198-2249-47b0-8fea-9fb84209123d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:21.495410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1193a198-2249-47b0-8fea-9fb84209123d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:21.502353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1193a198-2249-47b0-8fea-9fb84209123d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:21.504428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1193a198-2249-47b0-8fea-9fb84209123d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:21.505202 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1193a198-2249-47b0-8fea-9fb84209123d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:21.799611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0a7e835b-ff11-431e-b8f2-11ad47f91cc8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:21.808982 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0a7e835b-ff11-431e-b8f2-11ad47f91cc8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:21.811149 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0a7e835b-ff11-431e-b8f2-11ad47f91cc8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:21.812487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0a7e835b-ff11-431e-b8f2-11ad47f91cc8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1406 microversion: 2.20 time: 0.617975 Feb 17 03:27:21.813431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 54/118] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:27:21 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1406 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:27:22.023966 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6eaa08a4-c038-4dc8-b9e0-bb2301a760dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:22.025069 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6eaa08a4-c038-4dc8-b9e0-bb2301a760dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:22.035014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6eaa08a4-c038-4dc8-b9e0-bb2301a760dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:22.036105 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6eaa08a4-c038-4dc8-b9e0-bb2301a760dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:22.037161 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6eaa08a4-c038-4dc8-b9e0-bb2301a760dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:22.038028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6eaa08a4-c038-4dc8-b9e0-bb2301a760dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:22.072968 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1193a198-2249-47b0-8fea-9fb84209123d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:22.083921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1193a198-2249-47b0-8fea-9fb84209123d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.606456 Feb 17 03:27:22.085031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 65/119] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:21 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:22.099239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a8ee2dd7-9fe0-48dd-90c2-f47751a64b59 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:22.100167 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a8ee2dd7-9fe0-48dd-90c2-f47751a64b59 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:22.110810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a8ee2dd7-9fe0-48dd-90c2-f47751a64b59 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:22.111399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a8ee2dd7-9fe0-48dd-90c2-f47751a64b59 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:22.112367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a8ee2dd7-9fe0-48dd-90c2-f47751a64b59 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:22.112936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a8ee2dd7-9fe0-48dd-90c2-f47751a64b59 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:22.758531 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6eaa08a4-c038-4dc8-b9e0-bb2301a760dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:22.768703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6eaa08a4-c038-4dc8-b9e0-bb2301a760dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1363 microversion: 2.1 time: 0.749688 Feb 17 03:27:22.769560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 55/120] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:22 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1363 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:22.832267 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2669a673-f53f-4188-bad5-7fe11e6e3661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:22.833097 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2669a673-f53f-4188-bad5-7fe11e6e3661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:22.841505 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2669a673-f53f-4188-bad5-7fe11e6e3661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:22.842715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2669a673-f53f-4188-bad5-7fe11e6e3661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:22.843724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2669a673-f53f-4188-bad5-7fe11e6e3661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:22.844306 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2669a673-f53f-4188-bad5-7fe11e6e3661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:22.898062 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a8ee2dd7-9fe0-48dd-90c2-f47751a64b59 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:22.911986 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a8ee2dd7-9fe0-48dd-90c2-f47751a64b59 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1553 microversion: 2.1 time: 0.825639 Feb 17 03:27:22.922960 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 66/121] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:22 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1553 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:23.103055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b9139cfa-2ce4-48c1-903b-8a7599be9a26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:23.104318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b9139cfa-2ce4-48c1-903b-8a7599be9a26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:23.112435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b9139cfa-2ce4-48c1-903b-8a7599be9a26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:23.113234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b9139cfa-2ce4-48c1-903b-8a7599be9a26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:23.114087 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b9139cfa-2ce4-48c1-903b-8a7599be9a26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:23.114576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b9139cfa-2ce4-48c1-903b-8a7599be9a26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:23.417891 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2669a673-f53f-4188-bad5-7fe11e6e3661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:23.429807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2669a673-f53f-4188-bad5-7fe11e6e3661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:23.431744 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2669a673-f53f-4188-bad5-7fe11e6e3661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:23.433156 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2669a673-f53f-4188-bad5-7fe11e6e3661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1598 microversion: 2.20 time: 0.605070 Feb 17 03:27:23.449100 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 56/122] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:27:22 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1598 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:27:23.457512 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-508c6e52-ff05-4e0d-bde7-1a1a83c2a1d4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:23.458225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-508c6e52-ff05-4e0d-bde7-1a1a83c2a1d4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:23.467942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-508c6e52-ff05-4e0d-bde7-1a1a83c2a1d4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:23.468440 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-508c6e52-ff05-4e0d-bde7-1a1a83c2a1d4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:23.469268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-508c6e52-ff05-4e0d-bde7-1a1a83c2a1d4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:23.470020 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-508c6e52-ff05-4e0d-bde7-1a1a83c2a1d4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:23.981772 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b9139cfa-2ce4-48c1-903b-8a7599be9a26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:23.998879 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b9139cfa-2ce4-48c1-903b-8a7599be9a26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.896197 Feb 17 03:27:23.999736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 67/123] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:23 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:24.014438 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-82e935f7-9035-4b1b-92f2-f400e84bb526 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:24.016113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-82e935f7-9035-4b1b-92f2-f400e84bb526 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:24.039599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82e935f7-9035-4b1b-92f2-f400e84bb526 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:24.040335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82e935f7-9035-4b1b-92f2-f400e84bb526 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:24.041376 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82e935f7-9035-4b1b-92f2-f400e84bb526 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:24.041992 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82e935f7-9035-4b1b-92f2-f400e84bb526 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:24.050426 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-508c6e52-ff05-4e0d-bde7-1a1a83c2a1d4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.599505 Feb 17 03:27:24.057855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 57/124] 10.222.0.46 () {60 vars in 1306 bytes} [Wed Feb 17 03:27:23 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/os-interface => generated 285 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:27:24.064892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-48832c8c-4030-4b41-9ac8-624c559b50c6 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:24.066097 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-48832c8c-4030-4b41-9ac8-624c559b50c6 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:24.075743 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-48832c8c-4030-4b41-9ac8-624c559b50c6 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:24.077358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-48832c8c-4030-4b41-9ac8-624c559b50c6 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:24.079187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-48832c8c-4030-4b41-9ac8-624c559b50c6 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:24.079999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-48832c8c-4030-4b41-9ac8-624c559b50c6 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:25.584876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-48832c8c-4030-4b41-9ac8-624c559b50c6 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:25.601161 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-48832c8c-4030-4b41-9ac8-624c559b50c6 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1553 microversion: 2.1 time: 1.541467 Feb 17 03:27:25.601804 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 58/125] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:24 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1553 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:25.616623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-94224d7e-34a3-41f4-8421-b8617345ae95 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:25.617800 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-94224d7e-34a3-41f4-8421-b8617345ae95 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:25.626112 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-94224d7e-34a3-41f4-8421-b8617345ae95 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:25.626822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-94224d7e-34a3-41f4-8421-b8617345ae95 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:25.627829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-94224d7e-34a3-41f4-8421-b8617345ae95 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:25.628568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-94224d7e-34a3-41f4-8421-b8617345ae95 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:25.646533 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-82e935f7-9035-4b1b-92f2-f400e84bb526 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:25.664854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-82e935f7-9035-4b1b-92f2-f400e84bb526 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1363 microversion: 2.1 time: 1.662098 Feb 17 03:27:25.665451 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 68/126] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:24 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1363 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:25.674828 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-a7db4111-09ba-4c22-9ceb-1d428f5da86d req-980d2bef-e2f1-4e57-abf6-bd2044d95fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415389d3-caaf-4b28-9090-426e4fe11633", "name": "network-vif-plugged", "status": "completed", "tag": "2de00b31-a873-47bd-8a1b-654da9855749"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:25.677670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:25.677670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:25.687711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-a7db4111-09ba-4c22-9ceb-1d428f5da86d req-980d2bef-e2f1-4e57-abf6-bd2044d95fb7 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:25.688557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-a7db4111-09ba-4c22-9ceb-1d428f5da86d req-980d2bef-e2f1-4e57-abf6-bd2044d95fb7 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:25.720940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-a7db4111-09ba-4c22-9ceb-1d428f5da86d req-980d2bef-e2f1-4e57-abf6-bd2044d95fb7 service nova] Creating event network-vif-plugged:2de00b31-a873-47bd-8a1b-654da9855749 for instance 415389d3-caaf-4b28-9090-426e4fe11633 on hv-cinder-75996 Feb 17 03:27:25.731675 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-a7db4111-09ba-4c22-9ceb-1d428f5da86d req-980d2bef-e2f1-4e57-abf6-bd2044d95fb7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060385 Feb 17 03:27:25.732316 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 69/127] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:25.743166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-f9f6a5be-faf3-443f-8aed-90e606a277a5 req-7fb066a2-0da3-4992-ac8b-14f9981df805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3", "name": "network-vif-deleted", "tag": "720dde26-b646-463c-981e-62d7f5b221b3"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:25.744916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:25.744916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:25.755854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f9f6a5be-faf3-443f-8aed-90e606a277a5 req-7fb066a2-0da3-4992-ac8b-14f9981df805 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:25.756356 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f9f6a5be-faf3-443f-8aed-90e606a277a5 req-7fb066a2-0da3-4992-ac8b-14f9981df805 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:25.774815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-f9f6a5be-faf3-443f-8aed-90e606a277a5 req-7fb066a2-0da3-4992-ac8b-14f9981df805 service nova] Creating event network-vif-deleted:720dde26-b646-463c-981e-62d7f5b221b3 for instance ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 on hv-cinder-75996 Feb 17 03:27:25.780911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-f9f6a5be-faf3-443f-8aed-90e606a277a5 req-7fb066a2-0da3-4992-ac8b-14f9981df805 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043603 Feb 17 03:27:25.781750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 70/128] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:26.369102 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-94224d7e-34a3-41f4-8421-b8617345ae95 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:26.380113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-94224d7e-34a3-41f4-8421-b8617345ae95 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.769266 Feb 17 03:27:26.381056 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 59/129] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:25 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:26.620784 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9659ddd4-ace8-4c0a-baa5-87b4b6bfbca2 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:26.621534 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9659ddd4-ace8-4c0a-baa5-87b4b6bfbca2 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:26.631622 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9659ddd4-ace8-4c0a-baa5-87b4b6bfbca2 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:26.632441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9659ddd4-ace8-4c0a-baa5-87b4b6bfbca2 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:26.633528 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9659ddd4-ace8-4c0a-baa5-87b4b6bfbca2 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:26.634217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9659ddd4-ace8-4c0a-baa5-87b4b6bfbca2 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:26.683803 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1cb073b8-2824-4e55-855e-6469e856ddc4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:26.685046 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1cb073b8-2824-4e55-855e-6469e856ddc4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:26.707890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1cb073b8-2824-4e55-855e-6469e856ddc4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:26.709196 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1cb073b8-2824-4e55-855e-6469e856ddc4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:26.710876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1cb073b8-2824-4e55-855e-6469e856ddc4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:26.711628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1cb073b8-2824-4e55-855e-6469e856ddc4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:26.955206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9659ddd4-ace8-4c0a-baa5-87b4b6bfbca2 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560d1af7aacc4347a22fb40a5d0bb5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa60503a7ed745c896b1149681ae4d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:26.971761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9659ddd4-ace8-4c0a-baa5-87b4b6bfbca2 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 200 len: 1346 microversion: 2.1 time: 0.356246 Feb 17 03:27:26.973183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 71/130] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:26 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 1346 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:27.399946 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-80aaf3ca-7298-47ee-9cd0-a378aa7ed568 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:27.401664 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-80aaf3ca-7298-47ee-9cd0-a378aa7ed568 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:27.429759 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-80aaf3ca-7298-47ee-9cd0-a378aa7ed568 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:27.432512 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-80aaf3ca-7298-47ee-9cd0-a378aa7ed568 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:27.433605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-80aaf3ca-7298-47ee-9cd0-a378aa7ed568 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:27.438747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-80aaf3ca-7298-47ee-9cd0-a378aa7ed568 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:27.524319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1cb073b8-2824-4e55-855e-6469e856ddc4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:27.534191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1cb073b8-2824-4e55-855e-6469e856ddc4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1363 microversion: 2.1 time: 0.855526 Feb 17 03:27:27.538217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 60/131] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:26 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1363 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:27.840202 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-741143761", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "networks": [{"uuid": "14692b9d-40c8-4147-9ef2-2084ebbdc286"}]}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:27.925308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] validate_networks() for [('14692b9d-40c8-4147-9ef2-2084ebbdc286', None, None, None)] {{(pid=98183) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:27:28.076352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-80aaf3ca-7298-47ee-9cd0-a378aa7ed568 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:28.093326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-80aaf3ca-7298-47ee-9cd0-a378aa7ed568 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.699163 Feb 17 03:27:28.094280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 72/132] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:27 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:28.101111 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-936d1a35-d972-47c6-a48e-3da6a83651c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:28.102425 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-936d1a35-d972-47c6-a48e-3da6a83651c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:28.130934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-936d1a35-d972-47c6-a48e-3da6a83651c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.132230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-936d1a35-d972-47c6-a48e-3da6a83651c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.134475 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-936d1a35-d972-47c6-a48e-3da6a83651c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.136568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-936d1a35-d972-47c6-a48e-3da6a83651c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.629227 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-936d1a35-d972-47c6-a48e-3da6a83651c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 14 microversion: 2.20 time: 0.532907 Feb 17 03:27:28.633218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 73/133] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:28 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 14 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:28.640181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-d89ea0db-ff76-4f09-9e3d-31966b0274d3 req-c4654593-844f-4645-8fc3-3436e5298903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89d14a3-493e-413a-918e-fd2de544e689", "tag": "8e645981-866a-495c-83c8-d0e1206a99d1"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:28.642326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:28.642326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:28.677358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-d89ea0db-ff76-4f09-9e3d-31966b0274d3 req-c4654593-844f-4645-8fc3-3436e5298903 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.680100 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-d89ea0db-ff76-4f09-9e3d-31966b0274d3 req-c4654593-844f-4645-8fc3-3436e5298903 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.718849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-d89ea0db-ff76-4f09-9e3d-31966b0274d3 req-c4654593-844f-4645-8fc3-3436e5298903 service nova] Creating event network-changed:8e645981-866a-495c-83c8-d0e1206a99d1 for instance a89d14a3-493e-413a-918e-fd2de544e689 on hv-cinder-75996 Feb 17 03:27:28.732486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-d89ea0db-ff76-4f09-9e3d-31966b0274d3 req-c4654593-844f-4645-8fc3-3436e5298903 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097201 Feb 17 03:27:28.733486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 74/134] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:28.743434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Flavor limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:27:28.743929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Image limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:27:28.744462 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Flavor pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:27:28.744915 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Image pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:27:28.745367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:27:28.746404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b0c4f1fe-c3b0-44a9-887b-f949ecbc8732 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:28.747765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b0c4f1fe-c3b0-44a9-887b-f949ecbc8732 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:28.756722 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0c4f1fe-c3b0-44a9-887b-f949ecbc8732 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.757688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0c4f1fe-c3b0-44a9-887b-f949ecbc8732 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.758755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0c4f1fe-c3b0-44a9-887b-f949ecbc8732 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.759439 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0c4f1fe-c3b0-44a9-887b-f949ecbc8732 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.762162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.765861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.767287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.769548 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.816236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Getting quotas for project 0ade3597251b451eb7a31a1c95528adf. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:28.830084 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Getting quotas for user 41a15644050d496c9d4a641eb5f8f088 and project 0ade3597251b451eb7a31a1c95528adf. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:28.859116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Going to run 1 instances... {{(pid=98183) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:27:28.864678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:27:28.885409 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-b0c4f1fe-c3b0-44a9-887b-f949ecbc8732 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] HTTP exception thrown: Instance ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 could not be found. Feb 17 03:27:28.886268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b0c4f1fe-c3b0-44a9-887b-f949ecbc8732 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Returning 404 to user: Instance ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:27:28.887296 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b0c4f1fe-c3b0-44a9-887b-f949ecbc8732 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 404 len: 111 microversion: 2.1 time: 0.152382 Feb 17 03:27:28.891896 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 75/135] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:28 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:27:28.905398 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-78ed8c2e-74ba-492b-b1e5-bee86250dee4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:28.906309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-78ed8c2e-74ba-492b-b1e5-bee86250dee4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:28.923838 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-78ed8c2e-74ba-492b-b1e5-bee86250dee4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.927476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-78ed8c2e-74ba-492b-b1e5-bee86250dee4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.928621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-78ed8c2e-74ba-492b-b1e5-bee86250dee4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.929332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-78ed8c2e-74ba-492b-b1e5-bee86250dee4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.962152 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-be136128-55db-4875-b49a-5012268b5423 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125983 Feb 17 03:27:28.962846 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 61/136] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:27:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 03:27:28.974723 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9bc11a3b-bf34-4f5e-903e-18189bcb7c30 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:28.975384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9bc11a3b-bf34-4f5e-903e-18189bcb7c30 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:29.191998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9bc11a3b-bf34-4f5e-903e-18189bcb7c30 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:29.205645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9bc11a3b-bf34-4f5e-903e-18189bcb7c30 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1217 microversion: 2.1 time: 0.235943 Feb 17 03:27:29.215542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 62/137] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:28 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1217 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:29.215542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6d4af1b2-7f6a-4f04-985f-7f17f161bb92 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:29.215542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6d4af1b2-7f6a-4f04-985f-7f17f161bb92 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:29.252115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6d4af1b2-7f6a-4f04-985f-7f17f161bb92 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:29.252620 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6d4af1b2-7f6a-4f04-985f-7f17f161bb92 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:29.253467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6d4af1b2-7f6a-4f04-985f-7f17f161bb92 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:29.253949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6d4af1b2-7f6a-4f04-985f-7f17f161bb92 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:29.440941 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-78ed8c2e-74ba-492b-b1e5-bee86250dee4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:29.451176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-78ed8c2e-74ba-492b-b1e5-bee86250dee4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1363 microversion: 2.1 time: 0.557914 Feb 17 03:27:29.468137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 76/138] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:28 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1363 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:29.649823 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9b5ca45a-379a-4f46-ad69-c87fdf5835b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:29.651410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9b5ca45a-379a-4f46-ad69-c87fdf5835b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:29.660787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9b5ca45a-379a-4f46-ad69-c87fdf5835b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:29.661516 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9b5ca45a-379a-4f46-ad69-c87fdf5835b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:29.662553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9b5ca45a-379a-4f46-ad69-c87fdf5835b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:29.663801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9b5ca45a-379a-4f46-ad69-c87fdf5835b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:29.739457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6d4af1b2-7f6a-4f04-985f-7f17f161bb92 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:29.754424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6d4af1b2-7f6a-4f04-985f-7f17f161bb92 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.546734 Feb 17 03:27:29.780137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 63/139] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:29 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:29.910903 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9b5ca45a-379a-4f46-ad69-c87fdf5835b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 14 microversion: 2.20 time: 0.273332 Feb 17 03:27:29.914573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 77/140] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:29 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 14 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:29.929239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-184519597", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "networks": [{"uuid": "c9e968ce-a441-4cd4-bf98-653e33e3e7b8"}]}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:30.002534 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] validate_networks() for [('c9e968ce-a441-4cd4-bf98-653e33e3e7b8', None, None, None)] {{(pid=98183) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:27:30.228268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-46e13d7f-033d-4224-a777-0a6ad8f71753 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:30.228959 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-46e13d7f-033d-4224-a777-0a6ad8f71753 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:30.249290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46e13d7f-033d-4224-a777-0a6ad8f71753 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:30.249837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46e13d7f-033d-4224-a777-0a6ad8f71753 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:30.250711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46e13d7f-033d-4224-a777-0a6ad8f71753 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:30.251211 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46e13d7f-033d-4224-a777-0a6ad8f71753 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:30.481800 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-46e13d7f-033d-4224-a777-0a6ad8f71753 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:30.490567 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-46e13d7f-033d-4224-a777-0a6ad8f71753 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1213 microversion: 2.1 time: 0.268337 Feb 17 03:27:30.501836 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 78/141] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:30 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1213 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:30.506931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f3eec382-2aae-43e9-8e6c-0438b187dcc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:30.507608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f3eec382-2aae-43e9-8e6c-0438b187dcc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:30.515981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f3eec382-2aae-43e9-8e6c-0438b187dcc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:30.516490 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f3eec382-2aae-43e9-8e6c-0438b187dcc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:30.517337 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f3eec382-2aae-43e9-8e6c-0438b187dcc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:30.517829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f3eec382-2aae-43e9-8e6c-0438b187dcc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:30.788912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Flavor limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:27:30.789386 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Image limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:27:30.789901 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Flavor pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:27:30.790721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Image pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:27:30.791230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:27:30.805257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:30.805966 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:30.807059 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:30.807825 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:30.828476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Getting quotas for project aa1d7bf87bab45169741a768823d447b. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:30.845042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Getting quotas for user 84384593523349cd83241278c8e7de5a and project aa1d7bf87bab45169741a768823d447b. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:30.858911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Going to run 1 instances... {{(pid=98183) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:27:30.862206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:27:30.864602 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f3eec382-2aae-43e9-8e6c-0438b187dcc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:30.874324 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f3eec382-2aae-43e9-8e6c-0438b187dcc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1549 microversion: 2.1 time: 0.371293 Feb 17 03:27:30.876386 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 79/142] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:30 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1549 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:30.887369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c4c3efaf-561e-4e27-8377-4cc040632478 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:30.888346 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c4c3efaf-561e-4e27-8377-4cc040632478 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:30.896964 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c4c3efaf-561e-4e27-8377-4cc040632478 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:30.897728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c4c3efaf-561e-4e27-8377-4cc040632478 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:30.898767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c4c3efaf-561e-4e27-8377-4cc040632478 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:30.899503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c4c3efaf-561e-4e27-8377-4cc040632478 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:30.973271 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4277af33-f17d-4437-ba27-792a6e7ea562 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047925 Feb 17 03:27:30.979169 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 64/143] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:27:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:27:31.000580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-271994a1-1358-47e5-8eac-af3463eb003b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:31.001339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-271994a1-1358-47e5-8eac-af3463eb003b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:31.010780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-271994a1-1358-47e5-8eac-af3463eb003b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.011629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-271994a1-1358-47e5-8eac-af3463eb003b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:31.012664 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-271994a1-1358-47e5-8eac-af3463eb003b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.013366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-271994a1-1358-47e5-8eac-af3463eb003b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:31.389330 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c4c3efaf-561e-4e27-8377-4cc040632478 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:31.402747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c4c3efaf-561e-4e27-8377-4cc040632478 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.524942 Feb 17 03:27:31.415037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 80/144] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:30 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:31.421090 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8d9f5eef-38e3-4b6a-8d3b-925f20ba5dda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:31.431712 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8d9f5eef-38e3-4b6a-8d3b-925f20ba5dda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:31.454115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8d9f5eef-38e3-4b6a-8d3b-925f20ba5dda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.454683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8d9f5eef-38e3-4b6a-8d3b-925f20ba5dda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:31.457532 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8d9f5eef-38e3-4b6a-8d3b-925f20ba5dda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.457532 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8d9f5eef-38e3-4b6a-8d3b-925f20ba5dda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:31.475886 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-271994a1-1358-47e5-8eac-af3463eb003b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.497050 Feb 17 03:27:31.476599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 65/145] 10.222.0.46 () {58 vars in 1265 bytes} [Wed Feb 17 03:27:30 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/os-interface => generated 285 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:31.488651 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3370c4f3-4d10-4bfb-a1a1-31d74f350ea3 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:31.489203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3370c4f3-4d10-4bfb-a1a1-31d74f350ea3 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:31.506474 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3370c4f3-4d10-4bfb-a1a1-31d74f350ea3 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.520250 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3370c4f3-4d10-4bfb-a1a1-31d74f350ea3 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:31.521764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3370c4f3-4d10-4bfb-a1a1-31d74f350ea3 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.522347 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3370c4f3-4d10-4bfb-a1a1-31d74f350ea3 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:31.642984 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-3370c4f3-4d10-4bfb-a1a1-31d74f350ea3 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] HTTP exception thrown: Instance ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 could not be found. Feb 17 03:27:31.644499 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3370c4f3-4d10-4bfb-a1a1-31d74f350ea3 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Returning 404 to user: Instance ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:27:31.645430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3370c4f3-4d10-4bfb-a1a1-31d74f350ea3 tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 404 len: 111 microversion: 2.1 time: 0.160769 Feb 17 03:27:31.646077 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 66/146] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:27:31 2021] DELETE /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:27:31.666862 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-328a9ec9-2176-4d82-b10f-9d08b4528665 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:31.667574 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-328a9ec9-2176-4d82-b10f-9d08b4528665 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:31.675917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-328a9ec9-2176-4d82-b10f-9d08b4528665 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.676421 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-328a9ec9-2176-4d82-b10f-9d08b4528665 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:31.677277 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-328a9ec9-2176-4d82-b10f-9d08b4528665 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.677756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-328a9ec9-2176-4d82-b10f-9d08b4528665 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:31.702181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8d9f5eef-38e3-4b6a-8d3b-925f20ba5dda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 14 microversion: 2.20 time: 0.284896 Feb 17 03:27:31.703861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 81/147] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:31 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 14 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:31.714177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4bdf7649-e3d5-4c83-8bd4-e91785e11a3e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:31.716477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4bdf7649-e3d5-4c83-8bd4-e91785e11a3e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:31.729431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4bdf7649-e3d5-4c83-8bd4-e91785e11a3e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.730325 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4bdf7649-e3d5-4c83-8bd4-e91785e11a3e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:31.731598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4bdf7649-e3d5-4c83-8bd4-e91785e11a3e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.732281 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4bdf7649-e3d5-4c83-8bd4-e91785e11a3e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:32.164329 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-328a9ec9-2176-4d82-b10f-9d08b4528665 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:32.171135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4bdf7649-e3d5-4c83-8bd4-e91785e11a3e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:32.178742 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-328a9ec9-2176-4d82-b10f-9d08b4528665 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1222 microversion: 2.1 time: 0.531445 Feb 17 03:27:32.188682 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 67/148] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:31 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1222 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:32.190694 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4bdf7649-e3d5-4c83-8bd4-e91785e11a3e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1275 microversion: 2.1 time: 0.485198 Feb 17 03:27:32.191436 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 82/149] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:31 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1275 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:32.197217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d28109ab-6023-46ac-97bc-28bd082f7c3a tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:32.198135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d28109ab-6023-46ac-97bc-28bd082f7c3a tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] [instance: ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:32.209752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d28109ab-6023-46ac-97bc-28bd082f7c3a tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:32.210639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d28109ab-6023-46ac-97bc-28bd082f7c3a tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:32.212499 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d28109ab-6023-46ac-97bc-28bd082f7c3a tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:32.213205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d28109ab-6023-46ac-97bc-28bd082f7c3a tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:32.331053 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-d28109ab-6023-46ac-97bc-28bd082f7c3a tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] HTTP exception thrown: Instance ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 could not be found. Feb 17 03:27:32.331815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d28109ab-6023-46ac-97bc-28bd082f7c3a tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] Returning 404 to user: Instance ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:27:32.332798 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d28109ab-6023-46ac-97bc-28bd082f7c3a tempest-DeleteServersTestJSON-580641312 tempest-DeleteServersTestJSON-580641312-project] 10.222.0.46 "GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3" status: 404 len: 111 microversion: 2.1 time: 0.142654 Feb 17 03:27:32.353242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 68/150] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:32 2021] GET /compute/v2.1/servers/ac3bbcbe-1b04-4dde-b7e0-a493289dfeb3 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:27:32.421418 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0f47e443-fda8-4675-a6d0-75aff02acbd4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:32.426319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0f47e443-fda8-4675-a6d0-75aff02acbd4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:32.446605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0f47e443-fda8-4675-a6d0-75aff02acbd4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:32.449197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0f47e443-fda8-4675-a6d0-75aff02acbd4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:32.455114 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0f47e443-fda8-4675-a6d0-75aff02acbd4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:32.455786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0f47e443-fda8-4675-a6d0-75aff02acbd4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:32.715133 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0db8a07a-7c1d-463e-9d05-6ae56192b357 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:32.716306 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0db8a07a-7c1d-463e-9d05-6ae56192b357 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:32.731871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0db8a07a-7c1d-463e-9d05-6ae56192b357 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:32.732421 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0db8a07a-7c1d-463e-9d05-6ae56192b357 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:32.733274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0db8a07a-7c1d-463e-9d05-6ae56192b357 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:32.733761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0db8a07a-7c1d-463e-9d05-6ae56192b357 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:32.972678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0db8a07a-7c1d-463e-9d05-6ae56192b357 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 14 microversion: 2.20 time: 0.261324 Feb 17 03:27:32.973350 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 69/151] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:32 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 14 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:33.199894 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-799fb24e-f329-4edf-b2e4-f2fae9aba83c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:33.201869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-799fb24e-f329-4edf-b2e4-f2fae9aba83c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:33.214754 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-799fb24e-f329-4edf-b2e4-f2fae9aba83c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:33.216183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-799fb24e-f329-4edf-b2e4-f2fae9aba83c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:33.217513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-799fb24e-f329-4edf-b2e4-f2fae9aba83c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:33.218922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-799fb24e-f329-4edf-b2e4-f2fae9aba83c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:33.230277 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0f47e443-fda8-4675-a6d0-75aff02acbd4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:33.245683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0f47e443-fda8-4675-a6d0-75aff02acbd4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.827876 Feb 17 03:27:33.247255 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 83/152] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:32 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:33.253488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f5d6d738-38c2-483e-a315-f81293137cb4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:33.254367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f5d6d738-38c2-483e-a315-f81293137cb4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:33.263108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f5d6d738-38c2-483e-a315-f81293137cb4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:33.264248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f5d6d738-38c2-483e-a315-f81293137cb4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:33.265310 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f5d6d738-38c2-483e-a315-f81293137cb4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:33.266234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f5d6d738-38c2-483e-a315-f81293137cb4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:33.435402 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-799fb24e-f329-4edf-b2e4-f2fae9aba83c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:33.445384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-799fb24e-f329-4edf-b2e4-f2fae9aba83c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1276 microversion: 2.1 time: 0.249997 Feb 17 03:27:33.446367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 70/153] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:33 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1276 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:33.535707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f5d6d738-38c2-483e-a315-f81293137cb4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:33.546805 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f5d6d738-38c2-483e-a315-f81293137cb4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1275 microversion: 2.1 time: 0.296677 Feb 17 03:27:33.548372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 84/154] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:33 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1275 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:33.985971 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-06d8db52-56f2-495d-8b4a-f5626440afa3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:33.987753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-06d8db52-56f2-495d-8b4a-f5626440afa3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:34.000381 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-06d8db52-56f2-495d-8b4a-f5626440afa3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:34.001117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-06d8db52-56f2-495d-8b4a-f5626440afa3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:34.002120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-06d8db52-56f2-495d-8b4a-f5626440afa3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:34.002757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-06d8db52-56f2-495d-8b4a-f5626440afa3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:34.105957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1465168579", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "networks": [{"uuid": "b088fa35-a5b7-48ec-81c3-59d2072b22a6"}]}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:34.191954 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] validate_networks() for [('b088fa35-a5b7-48ec-81c3-59d2072b22a6', None, None, None)] {{(pid=98184) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:27:34.214735 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-06d8db52-56f2-495d-8b4a-f5626440afa3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 14 microversion: 2.20 time: 0.233822 Feb 17 03:27:34.216135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 71/155] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:33 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 14 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:34.268240 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-289d10b8-e87d-42a1-83ee-ae3dc4b81937 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:34.269782 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-289d10b8-e87d-42a1-83ee-ae3dc4b81937 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:34.283083 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-289d10b8-e87d-42a1-83ee-ae3dc4b81937 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:34.283681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-289d10b8-e87d-42a1-83ee-ae3dc4b81937 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:34.284553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-289d10b8-e87d-42a1-83ee-ae3dc4b81937 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:34.285572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-289d10b8-e87d-42a1-83ee-ae3dc4b81937 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:35.505786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-289d10b8-e87d-42a1-83ee-ae3dc4b81937 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:35.517380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-289d10b8-e87d-42a1-83ee-ae3dc4b81937 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 1.254943 Feb 17 03:27:35.519416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 72/156] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:34 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:35.528304 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8982497b-7a29-4499-bc8d-e03b73c0ac43 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:35.530075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8982497b-7a29-4499-bc8d-e03b73c0ac43 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:35.539440 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8982497b-7a29-4499-bc8d-e03b73c0ac43 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:35.540596 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8982497b-7a29-4499-bc8d-e03b73c0ac43 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:35.541525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8982497b-7a29-4499-bc8d-e03b73c0ac43 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:35.542098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8982497b-7a29-4499-bc8d-e03b73c0ac43 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:36.948809 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8982497b-7a29-4499-bc8d-e03b73c0ac43 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:36.963325 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8982497b-7a29-4499-bc8d-e03b73c0ac43 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1318 microversion: 2.1 time: 1.437863 Feb 17 03:27:36.963325 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 73/157] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:35 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1318 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:36.964583 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d5e2845a-6cdd-409f-b9a9-2ac20a3f02fc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:36.965365 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d5e2845a-6cdd-409f-b9a9-2ac20a3f02fc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:36.974499 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d5e2845a-6cdd-409f-b9a9-2ac20a3f02fc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:36.975026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d5e2845a-6cdd-409f-b9a9-2ac20a3f02fc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:36.976085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d5e2845a-6cdd-409f-b9a9-2ac20a3f02fc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:36.976721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d5e2845a-6cdd-409f-b9a9-2ac20a3f02fc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:36.989779 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Flavor limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:27:36.992239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Image limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:27:36.993012 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Flavor pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:27:36.993658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Image pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:27:36.994309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:27:37.012818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.024527 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:37.026459 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.027169 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:37.055975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Getting quotas for project b4f9108c28e441b4aa6c82ac5f4d640f. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:37.085228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Getting quotas for user 9c1d539ce3f64b8fad9994cf919422a2 and project b4f9108c28e441b4aa6c82ac5f4d640f. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:37.104685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Going to run 1 instances... {{(pid=98184) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:27:37.107842 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:27:37.187077 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b6904332-6451-4282-bf73-365d8b6b0036 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.082298 Feb 17 03:27:37.190816 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 85/158] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:27:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 3090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:27:37.196944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8770f38b-dcd6-4e46-936c-831b02965078 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:37.198594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8770f38b-dcd6-4e46-936c-831b02965078 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:37.209030 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8770f38b-dcd6-4e46-936c-831b02965078 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.209935 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8770f38b-dcd6-4e46-936c-831b02965078 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:37.210808 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8770f38b-dcd6-4e46-936c-831b02965078 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.211712 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8770f38b-dcd6-4e46-936c-831b02965078 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:37.380695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8770f38b-dcd6-4e46-936c-831b02965078 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 14 microversion: 2.20 time: 0.187996 Feb 17 03:27:37.381611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 86/159] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:37 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:37.389634 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-6dd54f13-b919-4608-adee-2b22cdcba8b6 req-add21d26-d77d-41c3-a668-8c38a0d23320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa71048-be77-41c2-9f9c-ff388c8c3445", "tag": "bbf1879d-8017-400d-8b73-01e598bd955f"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:37.391717 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:37.391717 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:37.403851 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-6dd54f13-b919-4608-adee-2b22cdcba8b6 req-add21d26-d77d-41c3-a668-8c38a0d23320 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.404598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-6dd54f13-b919-4608-adee-2b22cdcba8b6 req-add21d26-d77d-41c3-a668-8c38a0d23320 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:37.427297 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-6dd54f13-b919-4608-adee-2b22cdcba8b6 req-add21d26-d77d-41c3-a668-8c38a0d23320 service nova] Creating event network-changed:bbf1879d-8017-400d-8b73-01e598bd955f for instance caa71048-be77-41c2-9f9c-ff388c8c3445 on hv-cinder-75996 Feb 17 03:27:37.445482 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-6dd54f13-b919-4608-adee-2b22cdcba8b6 req-add21d26-d77d-41c3-a668-8c38a0d23320 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061943 Feb 17 03:27:37.446362 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 87/160] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:37.455851 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bf8d715d-9163-461f-8a09-c8568bebe1fb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:37.456623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bf8d715d-9163-461f-8a09-c8568bebe1fb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:37.465576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf8d715d-9163-461f-8a09-c8568bebe1fb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.466063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf8d715d-9163-461f-8a09-c8568bebe1fb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:37.466963 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf8d715d-9163-461f-8a09-c8568bebe1fb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.467460 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf8d715d-9163-461f-8a09-c8568bebe1fb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:37.656777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d5e2845a-6cdd-409f-b9a9-2ac20a3f02fc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:37.678054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d5e2845a-6cdd-409f-b9a9-2ac20a3f02fc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1317 microversion: 2.1 time: 0.717282 Feb 17 03:27:37.678921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 74/161] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:36 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1317 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:37.683973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0fe77745-248c-4562-9f33-adf6688f56c3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:37.685339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0fe77745-248c-4562-9f33-adf6688f56c3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:37.703623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0fe77745-248c-4562-9f33-adf6688f56c3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.704278 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0fe77745-248c-4562-9f33-adf6688f56c3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:37.705256 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0fe77745-248c-4562-9f33-adf6688f56c3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.705890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0fe77745-248c-4562-9f33-adf6688f56c3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:37.930611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0fe77745-248c-4562-9f33-adf6688f56c3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 14 microversion: 2.1 time: 0.249719 Feb 17 03:27:37.931379 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 75/162] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:37 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 14 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:27:37.937712 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b2fa9964-ee04-46fd-ab0c-b7e56e47346d tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:37.938708 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b2fa9964-ee04-46fd-ab0c-b7e56e47346d tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:37.948239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b2fa9964-ee04-46fd-ab0c-b7e56e47346d tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.948976 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b2fa9964-ee04-46fd-ab0c-b7e56e47346d tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:37.950373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b2fa9964-ee04-46fd-ab0c-b7e56e47346d tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.951061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b2fa9964-ee04-46fd-ab0c-b7e56e47346d tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:38.170671 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b2fa9964-ee04-46fd-ab0c-b7e56e47346d tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:38.185822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b2fa9964-ee04-46fd-ab0c-b7e56e47346d tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1218 microversion: 2.1 time: 0.252685 Feb 17 03:27:38.187882 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 76/163] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:37 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1218 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:38.192939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bf8d715d-9163-461f-8a09-c8568bebe1fb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:38.204167 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-0c3867fd-9e93-430c-9587-6b93cdddf2a5 req-a4b975f8-2224-4d12-b842-59e291ba9686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415389d3-caaf-4b28-9090-426e4fe11633", "tag": "2de00b31-a873-47bd-8a1b-654da9855749"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:38.206841 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:38.206841 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:38.208110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bf8d715d-9163-461f-8a09-c8568bebe1fb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.760569 Feb 17 03:27:38.208735 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 88/164] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:37 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:38.227368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f1112a76-ce99-42cb-9fc4-eaa9d16bdf13 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:38.228078 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f1112a76-ce99-42cb-9fc4-eaa9d16bdf13 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:38.237297 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-0c3867fd-9e93-430c-9587-6b93cdddf2a5 req-a4b975f8-2224-4d12-b842-59e291ba9686 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:38.241748 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-0c3867fd-9e93-430c-9587-6b93cdddf2a5 req-a4b975f8-2224-4d12-b842-59e291ba9686 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:38.257912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f1112a76-ce99-42cb-9fc4-eaa9d16bdf13 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:38.258470 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f1112a76-ce99-42cb-9fc4-eaa9d16bdf13 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:38.259296 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f1112a76-ce99-42cb-9fc4-eaa9d16bdf13 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:38.259999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f1112a76-ce99-42cb-9fc4-eaa9d16bdf13 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:38.288368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-0c3867fd-9e93-430c-9587-6b93cdddf2a5 req-a4b975f8-2224-4d12-b842-59e291ba9686 service nova] Creating event network-changed:2de00b31-a873-47bd-8a1b-654da9855749 for instance 415389d3-caaf-4b28-9090-426e4fe11633 on hv-cinder-75996 Feb 17 03:27:38.297945 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-0c3867fd-9e93-430c-9587-6b93cdddf2a5 req-a4b975f8-2224-4d12-b842-59e291ba9686 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106514 Feb 17 03:27:38.302184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 77/165] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:38.396561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4b786cd2-ccb3-4150-935b-1d83c2903be8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:38.399143 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4b786cd2-ccb3-4150-935b-1d83c2903be8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:38.411305 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4b786cd2-ccb3-4150-935b-1d83c2903be8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:38.412010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4b786cd2-ccb3-4150-935b-1d83c2903be8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:38.413265 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4b786cd2-ccb3-4150-935b-1d83c2903be8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:38.414492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4b786cd2-ccb3-4150-935b-1d83c2903be8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:38.610185 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4b786cd2-ccb3-4150-935b-1d83c2903be8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 14 microversion: 2.20 time: 0.218273 Feb 17 03:27:38.611215 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 78/166] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:38 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:38.697913 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-531a5555-4031-4c17-bb32-b8460ea90029 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:38.698768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-531a5555-4031-4c17-bb32-b8460ea90029 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:38.715264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-531a5555-4031-4c17-bb32-b8460ea90029 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:38.717298 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-531a5555-4031-4c17-bb32-b8460ea90029 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:38.718893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-531a5555-4031-4c17-bb32-b8460ea90029 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:38.720913 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-531a5555-4031-4c17-bb32-b8460ea90029 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:39.412223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f1112a76-ce99-42cb-9fc4-eaa9d16bdf13 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:39.422676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f1112a76-ce99-42cb-9fc4-eaa9d16bdf13 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1318 microversion: 2.1 time: 1.202045 Feb 17 03:27:39.428784 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 89/167] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:38 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1318 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:39.442044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-371068d9-a14d-4747-a59f-33ba7cdc4e08 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:39.443394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-371068d9-a14d-4747-a59f-33ba7cdc4e08 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:39.452600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-371068d9-a14d-4747-a59f-33ba7cdc4e08 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:39.453787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-371068d9-a14d-4747-a59f-33ba7cdc4e08 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:39.454830 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-371068d9-a14d-4747-a59f-33ba7cdc4e08 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:39.455556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-371068d9-a14d-4747-a59f-33ba7cdc4e08 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:39.566724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-531a5555-4031-4c17-bb32-b8460ea90029 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:39.582515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-531a5555-4031-4c17-bb32-b8460ea90029 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1317 microversion: 2.1 time: 0.885852 Feb 17 03:27:39.584237 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 79/168] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:38 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1317 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:39.592468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-73cfae6d-72ff-4a72-8c0c-79d15ec17b25 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:39.593297 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-73cfae6d-72ff-4a72-8c0c-79d15ec17b25 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:39.622001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73cfae6d-72ff-4a72-8c0c-79d15ec17b25 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:39.622843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73cfae6d-72ff-4a72-8c0c-79d15ec17b25 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:39.623889 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73cfae6d-72ff-4a72-8c0c-79d15ec17b25 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:39.624379 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73cfae6d-72ff-4a72-8c0c-79d15ec17b25 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:39.634560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-371068d9-a14d-4747-a59f-33ba7cdc4e08 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 14 microversion: 2.1 time: 0.204117 Feb 17 03:27:39.635254 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 90/169] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:39 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 14 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:27:39.640936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a1d5bf31-e8b8-4678-850d-65a443337c67 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:39.641700 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a1d5bf31-e8b8-4678-850d-65a443337c67 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:39.671099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a1d5bf31-e8b8-4678-850d-65a443337c67 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:39.671636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a1d5bf31-e8b8-4678-850d-65a443337c67 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:39.672475 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a1d5bf31-e8b8-4678-850d-65a443337c67 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:39.678869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a1d5bf31-e8b8-4678-850d-65a443337c67 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:39.901822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-73cfae6d-72ff-4a72-8c0c-79d15ec17b25 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:39.914599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-73cfae6d-72ff-4a72-8c0c-79d15ec17b25 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1272 microversion: 2.1 time: 0.329098 Feb 17 03:27:39.916186 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 80/170] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:39 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1272 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:39.923169 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b3deb858-848a-4683-8abd-e6b9069e0a00 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:39.925189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b3deb858-848a-4683-8abd-e6b9069e0a00 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:39.934391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b3deb858-848a-4683-8abd-e6b9069e0a00 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:39.935185 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b3deb858-848a-4683-8abd-e6b9069e0a00 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:39.936747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b3deb858-848a-4683-8abd-e6b9069e0a00 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:39.937442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b3deb858-848a-4683-8abd-e6b9069e0a00 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:40.172789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b3deb858-848a-4683-8abd-e6b9069e0a00 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 14 microversion: 2.20 time: 0.253312 Feb 17 03:27:40.173482 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 81/171] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:39 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:40.298827 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a1d5bf31-e8b8-4678-850d-65a443337c67 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:40.308623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a1d5bf31-e8b8-4678-850d-65a443337c67 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.671820 Feb 17 03:27:40.309342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 91/172] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:39 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:40.325051 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-0964b48b-8c2d-43a0-87b3-44802e9aae94 req-a3c415f1-8e27-4858-bb65-471274b413fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0acdcb-31cb-4678-aabb-f0ac7feb02a7", "tag": "813ead8a-622d-4333-899c-033f729a5c55"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:40.326819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:40.326819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:40.336856 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-0964b48b-8c2d-43a0-87b3-44802e9aae94 req-a3c415f1-8e27-4858-bb65-471274b413fa service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:40.337428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-0964b48b-8c2d-43a0-87b3-44802e9aae94 req-a3c415f1-8e27-4858-bb65-471274b413fa service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:40.355921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-0964b48b-8c2d-43a0-87b3-44802e9aae94 req-a3c415f1-8e27-4858-bb65-471274b413fa service nova] Creating event network-changed:813ead8a-622d-4333-899c-033f729a5c55 for instance df0acdcb-31cb-4678-aabb-f0ac7feb02a7 on hv-cinder-75996 Feb 17 03:27:40.361665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-0964b48b-8c2d-43a0-87b3-44802e9aae94 req-a3c415f1-8e27-4858-bb65-471274b413fa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041179 Feb 17 03:27:40.362749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 82/173] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:40.446383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cebb353e-844c-464f-ac65-c14b3cb89d6e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:40.447720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cebb353e-844c-464f-ac65-c14b3cb89d6e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:40.456319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cebb353e-844c-464f-ac65-c14b3cb89d6e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:40.457245 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cebb353e-844c-464f-ac65-c14b3cb89d6e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:40.458498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cebb353e-844c-464f-ac65-c14b3cb89d6e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:40.459391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cebb353e-844c-464f-ac65-c14b3cb89d6e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:40.605043 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-30eac5f0-9357-4800-800b-ebb8ddc22562 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:40.605866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-30eac5f0-9357-4800-800b-ebb8ddc22562 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:40.615558 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-30eac5f0-9357-4800-800b-ebb8ddc22562 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:40.616069 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-30eac5f0-9357-4800-800b-ebb8ddc22562 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:40.616907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-30eac5f0-9357-4800-800b-ebb8ddc22562 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:40.617389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-30eac5f0-9357-4800-800b-ebb8ddc22562 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:41.462002 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cebb353e-844c-464f-ac65-c14b3cb89d6e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:41.473748 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cebb353e-844c-464f-ac65-c14b3cb89d6e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1318 microversion: 2.1 time: 1.031228 Feb 17 03:27:41.474377 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 92/174] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:40 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1318 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:41.479177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3b611f57-5da3-4de0-bff0-02fe329e75b6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:41.482802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-30eac5f0-9357-4800-800b-ebb8ddc22562 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:41.490688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3b611f57-5da3-4de0-bff0-02fe329e75b6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:41.495151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-30eac5f0-9357-4800-800b-ebb8ddc22562 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1317 microversion: 2.1 time: 0.896559 Feb 17 03:27:41.503159 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b611f57-5da3-4de0-bff0-02fe329e75b6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:41.503699 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b611f57-5da3-4de0-bff0-02fe329e75b6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:41.504561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b611f57-5da3-4de0-bff0-02fe329e75b6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:41.505031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b611f57-5da3-4de0-bff0-02fe329e75b6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:41.508154 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 83/175] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:40 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1317 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:41.513669 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7db29261-0a69-4360-b6d9-7084e1052c58 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:41.517340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7db29261-0a69-4360-b6d9-7084e1052c58 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:41.535219 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7db29261-0a69-4360-b6d9-7084e1052c58 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:41.535941 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7db29261-0a69-4360-b6d9-7084e1052c58 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:41.536855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7db29261-0a69-4360-b6d9-7084e1052c58 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:41.537487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7db29261-0a69-4360-b6d9-7084e1052c58 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:41.689233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3b611f57-5da3-4de0-bff0-02fe329e75b6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 14 microversion: 2.1 time: 0.213007 Feb 17 03:27:41.693649 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 93/176] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:41 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:27:41.700522 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-779124db-3586-4b81-8421-20de11b24f9d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:41.702119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-779124db-3586-4b81-8421-20de11b24f9d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:41.712079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-779124db-3586-4b81-8421-20de11b24f9d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:41.712848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-779124db-3586-4b81-8421-20de11b24f9d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:41.713895 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-779124db-3586-4b81-8421-20de11b24f9d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:41.715140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-779124db-3586-4b81-8421-20de11b24f9d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:41.883153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7db29261-0a69-4360-b6d9-7084e1052c58 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:41.897351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7db29261-0a69-4360-b6d9-7084e1052c58 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1314 microversion: 2.1 time: 0.387643 Feb 17 03:27:41.908600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 84/177] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:41 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:41.908600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-25c4ed23-0b28-4207-90b3-aef94021877e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:41.908600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-25c4ed23-0b28-4207-90b3-aef94021877e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:41.912272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-779124db-3586-4b81-8421-20de11b24f9d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 14 microversion: 2.20 time: 0.216323 Feb 17 03:27:41.915995 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 94/178] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:41 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:41.916634 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25c4ed23-0b28-4207-90b3-aef94021877e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:41.917218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25c4ed23-0b28-4207-90b3-aef94021877e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:41.918071 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25c4ed23-0b28-4207-90b3-aef94021877e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:41.918557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25c4ed23-0b28-4207-90b3-aef94021877e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:41.924759 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9ba662e4-3344-49d2-9735-deacf39ff398 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] Calling method '.version_select at 0x7f012df5c048>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:42.051021 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9ba662e4-3344-49d2-9735-deacf39ff398 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dbab2120-56c0-45b5-ba99-865ec8cc3091" status: 200 len: 351 microversion: 2.1 time: 0.132793 Feb 17 03:27:42.052056 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 95/179] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:27:41 2021] GET /compute/v2.1/os-volumes/dbab2120-56c0-45b5-ba99-865ec8cc3091 => generated 351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:42.057874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-86d4db49-4b01-42db-b157-acc573d0bd5c req-d7591483-8fcd-4a3d-9acd-e1a2225112f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa71048-be77-41c2-9f9c-ff388c8c3445", "name": "network-vif-plugged", "status": "completed", "tag": "bbf1879d-8017-400d-8b73-01e598bd955f"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:42.060285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:42.060285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:42.070944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-86d4db49-4b01-42db-b157-acc573d0bd5c req-d7591483-8fcd-4a3d-9acd-e1a2225112f7 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:42.071584 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-86d4db49-4b01-42db-b157-acc573d0bd5c req-d7591483-8fcd-4a3d-9acd-e1a2225112f7 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:42.091293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-86d4db49-4b01-42db-b157-acc573d0bd5c req-d7591483-8fcd-4a3d-9acd-e1a2225112f7 service nova] Creating event network-vif-plugged:bbf1879d-8017-400d-8b73-01e598bd955f for instance caa71048-be77-41c2-9f9c-ff388c8c3445 on hv-cinder-75996 Feb 17 03:27:42.101689 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-86d4db49-4b01-42db-b157-acc573d0bd5c req-d7591483-8fcd-4a3d-9acd-e1a2225112f7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048210 Feb 17 03:27:42.102611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 96/180] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:42.371869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-25c4ed23-0b28-4207-90b3-aef94021877e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:42.385075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-25c4ed23-0b28-4207-90b3-aef94021877e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.484426 Feb 17 03:27:42.388276 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 85/181] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:41 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:42.493712 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c6162435-69a7-43f7-b3b5-968e02da3dd5 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:42.496149 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c6162435-69a7-43f7-b3b5-968e02da3dd5 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:42.512609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8d3fcacc-5a2e-4b5a-be9b-ba6d7851bf6f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:42.513268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8d3fcacc-5a2e-4b5a-be9b-ba6d7851bf6f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:42.517415 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6162435-69a7-43f7-b3b5-968e02da3dd5 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:42.521709 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6162435-69a7-43f7-b3b5-968e02da3dd5 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:42.522715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6162435-69a7-43f7-b3b5-968e02da3dd5 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:42.523623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6162435-69a7-43f7-b3b5-968e02da3dd5 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:42.534486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8d3fcacc-5a2e-4b5a-be9b-ba6d7851bf6f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:42.535030 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8d3fcacc-5a2e-4b5a-be9b-ba6d7851bf6f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:42.536060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8d3fcacc-5a2e-4b5a-be9b-ba6d7851bf6f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:42.536549 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8d3fcacc-5a2e-4b5a-be9b-ba6d7851bf6f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:43.191637 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8d3fcacc-5a2e-4b5a-be9b-ba6d7851bf6f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:43.201307 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8d3fcacc-5a2e-4b5a-be9b-ba6d7851bf6f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1317 microversion: 2.1 time: 0.692557 Feb 17 03:27:43.202102 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 86/182] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:42 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:43.213322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c6162435-69a7-43f7-b3b5-968e02da3dd5 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:43.217145 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5c3a9985-eb66-4b3c-ae3a-596a4a8a9a27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:43.218429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5c3a9985-eb66-4b3c-ae3a-596a4a8a9a27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:43.224192 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c6162435-69a7-43f7-b3b5-968e02da3dd5 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1318 microversion: 2.1 time: 0.735256 Feb 17 03:27:43.235010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 97/183] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:42 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1318 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:43.235165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5c3a9985-eb66-4b3c-ae3a-596a4a8a9a27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:43.235165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5c3a9985-eb66-4b3c-ae3a-596a4a8a9a27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:43.235165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5c3a9985-eb66-4b3c-ae3a-596a4a8a9a27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:43.235165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5c3a9985-eb66-4b3c-ae3a-596a4a8a9a27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:43.235441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-73154a05-ace1-4f6f-9d6d-2fcd1211017b req-883cd89a-8ab3-40e8-980e-e19b34ca9220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247ca850-da30-4c84-9958-40dd68c23715", "tag": "f9cb44e1-39e1-42b7-8141-01ff54d40c3a"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:43.235441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:43.235441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:43.241162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-73154a05-ace1-4f6f-9d6d-2fcd1211017b req-883cd89a-8ab3-40e8-980e-e19b34ca9220 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:43.241665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-73154a05-ace1-4f6f-9d6d-2fcd1211017b req-883cd89a-8ab3-40e8-980e-e19b34ca9220 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:43.258501 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-73154a05-ace1-4f6f-9d6d-2fcd1211017b req-883cd89a-8ab3-40e8-980e-e19b34ca9220 service nova] Creating event network-changed:f9cb44e1-39e1-42b7-8141-01ff54d40c3a for instance 247ca850-da30-4c84-9958-40dd68c23715 on hv-cinder-75996 Feb 17 03:27:43.263446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-73154a05-ace1-4f6f-9d6d-2fcd1211017b req-883cd89a-8ab3-40e8-980e-e19b34ca9220 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037439 Feb 17 03:27:43.264130 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 98/184] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:43.271554 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f1573bc9-bf16-49da-86d8-955fe876eb90 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:43.272324 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f1573bc9-bf16-49da-86d8-955fe876eb90 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:43.280688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f1573bc9-bf16-49da-86d8-955fe876eb90 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:43.281186 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f1573bc9-bf16-49da-86d8-955fe876eb90 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:43.282005 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f1573bc9-bf16-49da-86d8-955fe876eb90 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:43.282496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f1573bc9-bf16-49da-86d8-955fe876eb90 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:43.532750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5c3a9985-eb66-4b3c-ae3a-596a4a8a9a27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 14 microversion: 2.1 time: 0.329092 Feb 17 03:27:43.536162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 87/185] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:43 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 14 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:27:43.539088 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-08e0f84d-68f2-43c1-b3c1-1e36e7aacbd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:43.540512 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-08e0f84d-68f2-43c1-b3c1-1e36e7aacbd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:43.551857 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-08e0f84d-68f2-43c1-b3c1-1e36e7aacbd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:43.552374 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-08e0f84d-68f2-43c1-b3c1-1e36e7aacbd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:43.553230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-08e0f84d-68f2-43c1-b3c1-1e36e7aacbd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:43.553712 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-08e0f84d-68f2-43c1-b3c1-1e36e7aacbd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:43.630988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f1573bc9-bf16-49da-86d8-955fe876eb90 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:43.640446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f1573bc9-bf16-49da-86d8-955fe876eb90 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1314 microversion: 2.1 time: 0.373041 Feb 17 03:27:43.641054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 99/186] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:43 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:43.645709 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-30998b3c-0118-464c-a4aa-bfc989728a81 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:43.646572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-30998b3c-0118-464c-a4aa-bfc989728a81 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:43.654914 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-30998b3c-0118-464c-a4aa-bfc989728a81 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:43.655416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-30998b3c-0118-464c-a4aa-bfc989728a81 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:43.656352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-30998b3c-0118-464c-a4aa-bfc989728a81 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:43.656845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-30998b3c-0118-464c-a4aa-bfc989728a81 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:43.753920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-08e0f84d-68f2-43c1-b3c1-1e36e7aacbd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 7714 microversion: 2.20 time: 0.218753 Feb 17 03:27:43.754614 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 88/187] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:43 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 7714 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:27:43.877097 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-30998b3c-0118-464c-a4aa-bfc989728a81 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:43.895373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-30998b3c-0118-464c-a4aa-bfc989728a81 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.247528 Feb 17 03:27:43.895373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 100/188] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:43 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:43.912739 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8aed993f-e492-4e70-87f6-210d92fd9a3e tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] Calling method '.version_select at 0x7f012e6141e0>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:44.010481 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8aed993f-e492-4e70-87f6-210d92fd9a3e tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c2ee399b-93ff-4aaf-b74d-d04a298bed5f" status: 200 len: 350 microversion: 2.1 time: 0.102080 Feb 17 03:27:44.011095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 89/189] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:27:43 2021] GET /compute/v2.1/os-volumes/c2ee399b-93ff-4aaf-b74d-d04a298bed5f => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:44.220850 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e05ae6f2-5f82-4b0b-81e0-fee4a0e668b9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:44.221673 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e05ae6f2-5f82-4b0b-81e0-fee4a0e668b9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:44.237991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e05ae6f2-5f82-4b0b-81e0-fee4a0e668b9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:44.238930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e05ae6f2-5f82-4b0b-81e0-fee4a0e668b9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:44.239947 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e05ae6f2-5f82-4b0b-81e0-fee4a0e668b9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:44.240835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e05ae6f2-5f82-4b0b-81e0-fee4a0e668b9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:44.242445 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2d5bdf2d-be1b-462e-8288-82ee206678f7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:44.243222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2d5bdf2d-be1b-462e-8288-82ee206678f7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:44.257304 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d5bdf2d-be1b-462e-8288-82ee206678f7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:44.257801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d5bdf2d-be1b-462e-8288-82ee206678f7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:44.258703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d5bdf2d-be1b-462e-8288-82ee206678f7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:44.259240 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d5bdf2d-be1b-462e-8288-82ee206678f7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:44.590090 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e05ae6f2-5f82-4b0b-81e0-fee4a0e668b9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:44.594259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2d5bdf2d-be1b-462e-8288-82ee206678f7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:44.599606 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e05ae6f2-5f82-4b0b-81e0-fee4a0e668b9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1317 microversion: 2.1 time: 0.383215 Feb 17 03:27:44.600431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 101/190] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:44 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:44.603635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2d5bdf2d-be1b-462e-8288-82ee206678f7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1318 microversion: 2.1 time: 0.365104 Feb 17 03:27:44.604477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 90/191] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:44 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:44.615047 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8203adef-1f5b-4cc0-900c-8c82edc18345 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:44.616191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8203adef-1f5b-4cc0-900c-8c82edc18345 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:44.624407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8203adef-1f5b-4cc0-900c-8c82edc18345 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:44.624902 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8203adef-1f5b-4cc0-900c-8c82edc18345 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:44.625712 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8203adef-1f5b-4cc0-900c-8c82edc18345 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:44.626197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8203adef-1f5b-4cc0-900c-8c82edc18345 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:44.658385 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b6e7d899-35ed-4bd1-a13a-e5af47c17e98 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:44.659201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b6e7d899-35ed-4bd1-a13a-e5af47c17e98 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:44.669415 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6e7d899-35ed-4bd1-a13a-e5af47c17e98 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:44.670530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6e7d899-35ed-4bd1-a13a-e5af47c17e98 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:44.671447 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6e7d899-35ed-4bd1-a13a-e5af47c17e98 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:44.672036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6e7d899-35ed-4bd1-a13a-e5af47c17e98 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:44.805612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8203adef-1f5b-4cc0-900c-8c82edc18345 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 14 microversion: 2.1 time: 0.193948 Feb 17 03:27:44.806669 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 102/192] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:44 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:27:44.814725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-aed73863-72a0-4b3f-9d38-5861302d242a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:44.815866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-aed73863-72a0-4b3f-9d38-5861302d242a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:44.824371 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aed73863-72a0-4b3f-9d38-5861302d242a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:44.824874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aed73863-72a0-4b3f-9d38-5861302d242a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:44.825711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aed73863-72a0-4b3f-9d38-5861302d242a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:44.826190 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aed73863-72a0-4b3f-9d38-5861302d242a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:44.894188 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b6e7d899-35ed-4bd1-a13a-e5af47c17e98 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:44.905611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b6e7d899-35ed-4bd1-a13a-e5af47c17e98 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1314 microversion: 2.1 time: 0.251258 Feb 17 03:27:44.915725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 91/193] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:44 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:44.915725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cf9b4728-5b96-4a36-85b0-b6c280502dae tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:44.915725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cf9b4728-5b96-4a36-85b0-b6c280502dae tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:44.919103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf9b4728-5b96-4a36-85b0-b6c280502dae tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:44.920232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf9b4728-5b96-4a36-85b0-b6c280502dae tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:44.921058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf9b4728-5b96-4a36-85b0-b6c280502dae tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:44.921539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf9b4728-5b96-4a36-85b0-b6c280502dae tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:45.068088 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-aed73863-72a0-4b3f-9d38-5861302d242a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 10893 microversion: 2.20 time: 0.257224 Feb 17 03:27:45.069218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 103/194] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:44 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 10893 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:27:45.137545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cf9b4728-5b96-4a36-85b0-b6c280502dae tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:45.146849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cf9b4728-5b96-4a36-85b0-b6c280502dae tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.239634 Feb 17 03:27:45.147457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 92/195] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:44 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:45.618602 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ace2dbe4-a021-4aa1-acd3-e6a148d89f98 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:45.619369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ace2dbe4-a021-4aa1-acd3-e6a148d89f98 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:45.620893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-03c1da4e-60c0-4573-b966-3a3a041e2c1b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:45.621733 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-03c1da4e-60c0-4573-b966-3a3a041e2c1b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:45.628258 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ace2dbe4-a021-4aa1-acd3-e6a148d89f98 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:45.628768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ace2dbe4-a021-4aa1-acd3-e6a148d89f98 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:45.629602 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ace2dbe4-a021-4aa1-acd3-e6a148d89f98 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:45.630091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ace2dbe4-a021-4aa1-acd3-e6a148d89f98 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:45.630700 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-03c1da4e-60c0-4573-b966-3a3a041e2c1b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:45.631207 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-03c1da4e-60c0-4573-b966-3a3a041e2c1b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:45.632092 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-03c1da4e-60c0-4573-b966-3a3a041e2c1b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:45.632583 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-03c1da4e-60c0-4573-b966-3a3a041e2c1b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:45.945908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ace2dbe4-a021-4aa1-acd3-e6a148d89f98 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:45.950150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-03c1da4e-60c0-4573-b966-3a3a041e2c1b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:45.954887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ace2dbe4-a021-4aa1-acd3-e6a148d89f98 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1317 microversion: 2.1 time: 0.340707 Feb 17 03:27:45.955487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 104/196] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:45 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:45.958936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-03c1da4e-60c0-4573-b966-3a3a041e2c1b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1508 microversion: 2.1 time: 0.342032 Feb 17 03:27:45.959530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 93/197] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:45 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:45.961633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-508f0f99-7843-43c5-9d4b-6969b4e94427 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] Calling method '.version_select at 0x7f012df5c598>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:45.964864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6b9c8991-7642-43c1-a44f-82ed390e05dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:45.966176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6b9c8991-7642-43c1-a44f-82ed390e05dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:45.974250 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b9c8991-7642-43c1-a44f-82ed390e05dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:45.974751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b9c8991-7642-43c1-a44f-82ed390e05dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:45.975652 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b9c8991-7642-43c1-a44f-82ed390e05dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:45.976139 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b9c8991-7642-43c1-a44f-82ed390e05dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.067019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-508f0f99-7843-43c5-9d4b-6969b4e94427 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3e30dd45-925a-46d8-b4cb-3b1541dbb2b6" status: 200 len: 350 microversion: 2.1 time: 0.109585 Feb 17 03:27:46.067960 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 105/198] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:27:45 2021] GET /compute/v2.1/os-volumes/3e30dd45-925a-46d8-b4cb-3b1541dbb2b6 => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:46.072831 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8085f166-b842-4607-86b0-9bdfa8b918b4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:46.075288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8085f166-b842-4607-86b0-9bdfa8b918b4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:46.082861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8085f166-b842-4607-86b0-9bdfa8b918b4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.083382 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8085f166-b842-4607-86b0-9bdfa8b918b4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.084301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8085f166-b842-4607-86b0-9bdfa8b918b4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.084798 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8085f166-b842-4607-86b0-9bdfa8b918b4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.140366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6b9c8991-7642-43c1-a44f-82ed390e05dd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 14 microversion: 2.1 time: 0.179218 Feb 17 03:27:46.141191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 94/199] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:45 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:27:46.146543 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-dd1b4ca9-a252-4d21-965e-5caa85b96f19 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] Calling method '.version_select at 0x7f012e613620>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:46.247018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-dd1b4ca9-a252-4d21-965e-5caa85b96f19 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.104455 Feb 17 03:27:46.248611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 95/200] 10.222.0.46 () {58 vars in 1124 bytes} [Wed Feb 17 03:27:46 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:46.254729 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-23ba56cf-0d32-4627-bc0b-099f42488146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:46.255952 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-23ba56cf-0d32-4627-bc0b-099f42488146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:46.264969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23ba56cf-0d32-4627-bc0b-099f42488146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.265477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23ba56cf-0d32-4627-bc0b-099f42488146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.266318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23ba56cf-0d32-4627-bc0b-099f42488146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.266806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23ba56cf-0d32-4627-bc0b-099f42488146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.346812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8085f166-b842-4607-86b0-9bdfa8b918b4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:46.355850 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8085f166-b842-4607-86b0-9bdfa8b918b4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1314 microversion: 2.1 time: 0.286987 Feb 17 03:27:46.356434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 106/201] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:46 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:46.361751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c6bdfa50-aaa5-432e-986d-779baea0e305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:46.362355 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c6bdfa50-aaa5-432e-986d-779baea0e305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:46.369965 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6bdfa50-aaa5-432e-986d-779baea0e305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.370470 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6bdfa50-aaa5-432e-986d-779baea0e305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.371295 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6bdfa50-aaa5-432e-986d-779baea0e305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.371811 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6bdfa50-aaa5-432e-986d-779baea0e305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.437958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-23ba56cf-0d32-4627-bc0b-099f42488146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 15025 microversion: 2.20 time: 0.188911 Feb 17 03:27:46.438764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 96/202] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:46 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 15025 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:27:46.444891 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6940bc59-c009-4f67-b956-d314ccd0bcb3 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] Calling method '.version_select at 0x7f012e613c80>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:46.574584 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6940bc59-c009-4f67-b956-d314ccd0bcb3 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.133489 Feb 17 03:27:46.575366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 97/203] 10.222.0.46 () {58 vars in 1139 bytes} [Wed Feb 17 03:27:46 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:46.588094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-eb903adb-58d1-4d2b-bbbb-e31e8de3d60f tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] Calling method '.version_select at 0x7f012e499488>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:46.608921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c6bdfa50-aaa5-432e-986d-779baea0e305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:46.619628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c6bdfa50-aaa5-432e-986d-779baea0e305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.262106 Feb 17 03:27:46.621126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 107/204] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:46 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:46.681126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-eb903adb-58d1-4d2b-bbbb-e31e8de3d60f tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095827 Feb 17 03:27:46.681777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 98/205] 10.222.0.46 () {58 vars in 1124 bytes} [Wed Feb 17 03:27:46 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:46.693819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a4e28885-1693-4dfb-afb7-d47741a21193 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] Calling method '.version_select at 0x7f013304ebf8>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:46.780292 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a4e28885-1693-4dfb-afb7-d47741a21193 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090252 Feb 17 03:27:46.780901 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 108/206] 10.222.0.46 () {58 vars in 1157 bytes} [Wed Feb 17 03:27:46 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:46.793292 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-386dac13-d59e-4330-8047-50ee73bdb6b4 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] Calling method '.version_select at 0x7f012e6139d8>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:46.878748 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-386dac13-d59e-4330-8047-50ee73bdb6b4 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.089376 Feb 17 03:27:46.879486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 99/207] 10.222.0.46 () {58 vars in 1160 bytes} [Wed Feb 17 03:27:46 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:46.892835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f1c49d83-e292-4bba-bc36-71129108f1dd tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] Calling method '.version_select at 0x7f012df95400>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:46.973514 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-606c459a-dac9-47e3-ac96-7c4a33947d8e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:46.974284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-606c459a-dac9-47e3-ac96-7c4a33947d8e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:46.982759 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-606c459a-dac9-47e3-ac96-7c4a33947d8e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.982902 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f1c49d83-e292-4bba-bc36-71129108f1dd tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.094414 Feb 17 03:27:46.983269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-606c459a-dac9-47e3-ac96-7c4a33947d8e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.988757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 109/208] 10.222.0.46 () {58 vars in 1145 bytes} [Wed Feb 17 03:27:46 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:46.988898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-606c459a-dac9-47e3-ac96-7c4a33947d8e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.988898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-606c459a-dac9-47e3-ac96-7c4a33947d8e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.994927 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-58716c6d-c868-4409-813d-efc307d79095 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] Calling method '.version_select at 0x7f012df5c9d8>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:47.085779 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-58716c6d-c868-4409-813d-efc307d79095 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.094383 Feb 17 03:27:47.086410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 110/209] 10.222.0.46 () {58 vars in 1178 bytes} [Wed Feb 17 03:27:46 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:27:47.098981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-81b73eea-9e42-4f79-bfc6-cac9b05ff807 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] Calling method '.version_select at 0x7f012f004400>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:47.186565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-81b73eea-9e42-4f79-bfc6-cac9b05ff807 tempest-VolumesTestJSON-461546913 tempest-VolumesTestJSON-461546913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.091682 Feb 17 03:27:47.187588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 111/210] 10.222.0.46 () {58 vars in 1145 bytes} [Wed Feb 17 03:27:47 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:47.192588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6b6b263f-0b0d-423c-af04-67ba6ec981de tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:47.195467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6b6b263f-0b0d-423c-af04-67ba6ec981de tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:47.217627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b6b263f-0b0d-423c-af04-67ba6ec981de tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:47.218154 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b6b263f-0b0d-423c-af04-67ba6ec981de tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:47.219019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b6b263f-0b0d-423c-af04-67ba6ec981de tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:47.223967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b6b263f-0b0d-423c-af04-67ba6ec981de tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:47.224093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-606c459a-dac9-47e3-ac96-7c4a33947d8e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:47.232803 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-606c459a-dac9-47e3-ac96-7c4a33947d8e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1317 microversion: 2.1 time: 0.262933 Feb 17 03:27:47.233415 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 100/211] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:46 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:47.374341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-df27f690-21c8-406a-964d-332a95b65f82 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:47.375004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-df27f690-21c8-406a-964d-332a95b65f82 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:47.382804 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df27f690-21c8-406a-964d-332a95b65f82 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:47.383311 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df27f690-21c8-406a-964d-332a95b65f82 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:47.384187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df27f690-21c8-406a-964d-332a95b65f82 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:47.384677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df27f690-21c8-406a-964d-332a95b65f82 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:47.401927 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6b6b263f-0b0d-423c-af04-67ba6ec981de tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 14 microversion: 2.1 time: 0.212976 Feb 17 03:27:47.402718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 112/212] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:47 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:27:47.451492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-608485d4-1b35-45c2-8169-6f35eee7f1c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:47.452521 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-608485d4-1b35-45c2-8169-6f35eee7f1c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:47.460969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-608485d4-1b35-45c2-8169-6f35eee7f1c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:47.461477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-608485d4-1b35-45c2-8169-6f35eee7f1c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:47.462306 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-608485d4-1b35-45c2-8169-6f35eee7f1c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:47.462794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-608485d4-1b35-45c2-8169-6f35eee7f1c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:47.649135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-608485d4-1b35-45c2-8169-6f35eee7f1c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 17037 microversion: 2.20 time: 0.202312 Feb 17 03:27:47.649775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 113/213] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:47 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 17037 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:27:47.655767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-159817e5-40cf-49d7-a2e1-609e3e7a067b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:47.656531 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-159817e5-40cf-49d7-a2e1-609e3e7a067b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:47.665170 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-159817e5-40cf-49d7-a2e1-609e3e7a067b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:47.665675 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-159817e5-40cf-49d7-a2e1-609e3e7a067b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:47.666518 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-159817e5-40cf-49d7-a2e1-609e3e7a067b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:47.667009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-159817e5-40cf-49d7-a2e1-609e3e7a067b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:47.900819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-df27f690-21c8-406a-964d-332a95b65f82 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:47.910744 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-df27f690-21c8-406a-964d-332a95b65f82 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1314 microversion: 2.1 time: 0.540312 Feb 17 03:27:47.911465 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 101/214] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:47 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:47.948605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-159817e5-40cf-49d7-a2e1-609e3e7a067b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:47.957919 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-159817e5-40cf-49d7-a2e1-609e3e7a067b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.306895 Feb 17 03:27:47.958564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 114/215] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:47 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:48.253088 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7bc6754e-863d-4239-b37b-88d4335c54e8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:48.253709 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7bc6754e-863d-4239-b37b-88d4335c54e8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:48.266656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bc6754e-863d-4239-b37b-88d4335c54e8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.267148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bc6754e-863d-4239-b37b-88d4335c54e8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.268095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bc6754e-863d-4239-b37b-88d4335c54e8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.268627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bc6754e-863d-4239-b37b-88d4335c54e8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.313442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-b59fdbc9-dcf4-406c-97af-952f473092f5 req-7b3c3c48-cb59-4f09-8d71-35d47e743a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0acdcb-31cb-4678-aabb-f0ac7feb02a7", "name": "network-vif-plugged", "status": "completed", "tag": "813ead8a-622d-4333-899c-033f729a5c55"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:48.315137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:48.315137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:48.325571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-b59fdbc9-dcf4-406c-97af-952f473092f5 req-7b3c3c48-cb59-4f09-8d71-35d47e743a50 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.326847 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-b59fdbc9-dcf4-406c-97af-952f473092f5 req-7b3c3c48-cb59-4f09-8d71-35d47e743a50 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.349401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-b59fdbc9-dcf4-406c-97af-952f473092f5 req-7b3c3c48-cb59-4f09-8d71-35d47e743a50 service nova] Creating event network-vif-plugged:813ead8a-622d-4333-899c-033f729a5c55 for instance df0acdcb-31cb-4678-aabb-f0ac7feb02a7 on hv-cinder-75996 Feb 17 03:27:48.361662 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-b59fdbc9-dcf4-406c-97af-952f473092f5 req-7b3c3c48-cb59-4f09-8d71-35d47e743a50 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053589 Feb 17 03:27:48.362703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 115/216] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:48.415864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-70e5a8c5-9f68-472d-bd3e-dfaa88598977 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:48.423287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-70e5a8c5-9f68-472d-bd3e-dfaa88598977 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:48.440473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-70e5a8c5-9f68-472d-bd3e-dfaa88598977 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.440982 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-70e5a8c5-9f68-472d-bd3e-dfaa88598977 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.447859 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-70e5a8c5-9f68-472d-bd3e-dfaa88598977 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.448369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-70e5a8c5-9f68-472d-bd3e-dfaa88598977 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.591615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7bc6754e-863d-4239-b37b-88d4335c54e8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:48.602496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7bc6754e-863d-4239-b37b-88d4335c54e8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1317 microversion: 2.1 time: 0.355822 Feb 17 03:27:48.603627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 102/217] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:48 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:48.655552 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-70e5a8c5-9f68-472d-bd3e-dfaa88598977 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 14 microversion: 2.1 time: 0.243862 Feb 17 03:27:48.658569 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 116/218] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:48 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 03:27:48.663573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b3e0e141-b5df-4b52-9acf-2ef723477229 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:48.664973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b3e0e141-b5df-4b52-9acf-2ef723477229 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:48.673884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b3e0e141-b5df-4b52-9acf-2ef723477229 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.674522 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b3e0e141-b5df-4b52-9acf-2ef723477229 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.675346 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b3e0e141-b5df-4b52-9acf-2ef723477229 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.675852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b3e0e141-b5df-4b52-9acf-2ef723477229 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.860180 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b3e0e141-b5df-4b52-9acf-2ef723477229 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 17808 microversion: 2.20 time: 0.202170 Feb 17 03:27:48.860869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 103/219] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:48 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 17808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:27:48.930466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1bcd5d45-39d1-4a69-8c56-9310c408b71f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:48.931274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1bcd5d45-39d1-4a69-8c56-9310c408b71f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:48.940465 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bcd5d45-39d1-4a69-8c56-9310c408b71f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.940972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bcd5d45-39d1-4a69-8c56-9310c408b71f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.941796 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bcd5d45-39d1-4a69-8c56-9310c408b71f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.942283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bcd5d45-39d1-4a69-8c56-9310c408b71f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.977944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c4d2ee5d-1fea-4e17-8386-0e1058d5bf65 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:48.978707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c4d2ee5d-1fea-4e17-8386-0e1058d5bf65 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:48.987951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c4d2ee5d-1fea-4e17-8386-0e1058d5bf65 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.988457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c4d2ee5d-1fea-4e17-8386-0e1058d5bf65 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.989333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c4d2ee5d-1fea-4e17-8386-0e1058d5bf65 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.989820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c4d2ee5d-1fea-4e17-8386-0e1058d5bf65 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:49.258322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1bcd5d45-39d1-4a69-8c56-9310c408b71f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:49.277621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1bcd5d45-39d1-4a69-8c56-9310c408b71f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1314 microversion: 2.1 time: 0.350981 Feb 17 03:27:49.277999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 117/220] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:48 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:49.280888 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c4d2ee5d-1fea-4e17-8386-0e1058d5bf65 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:49.289816 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c4d2ee5d-1fea-4e17-8386-0e1058d5bf65 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.316725 Feb 17 03:27:49.290409 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 104/221] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:48 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:49.620670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-03c3bf34-dba4-4fc7-8973-0f4330db9298 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:49.621360 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-03c3bf34-dba4-4fc7-8973-0f4330db9298 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:49.629103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-03c3bf34-dba4-4fc7-8973-0f4330db9298 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:49.629608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-03c3bf34-dba4-4fc7-8973-0f4330db9298 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:49.630432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-03c3bf34-dba4-4fc7-8973-0f4330db9298 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:49.630921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-03c3bf34-dba4-4fc7-8973-0f4330db9298 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:49.666157 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5a696950-d269-48e2-a912-c0e149a8094b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:49.667219 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5a696950-d269-48e2-a912-c0e149a8094b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:49.675107 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5a696950-d269-48e2-a912-c0e149a8094b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:49.675627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5a696950-d269-48e2-a912-c0e149a8094b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:49.676453 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5a696950-d269-48e2-a912-c0e149a8094b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:49.676937 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5a696950-d269-48e2-a912-c0e149a8094b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:49.832766 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5a696950-d269-48e2-a912-c0e149a8094b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 14 microversion: 2.1 time: 0.170410 Feb 17 03:27:49.833642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 105/222] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:49 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 03:27:49.848573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-03c3bf34-dba4-4fc7-8973-0f4330db9298 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:49.860667 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-03c3bf34-dba4-4fc7-8973-0f4330db9298 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1317 microversion: 2.1 time: 0.242679 Feb 17 03:27:49.860667 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 118/223] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:49 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:49.873605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-71ba3be9-97d8-4868-a9cf-b49fba09b281 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:49.874861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-71ba3be9-97d8-4868-a9cf-b49fba09b281 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:49.883558 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71ba3be9-97d8-4868-a9cf-b49fba09b281 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:49.884138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71ba3be9-97d8-4868-a9cf-b49fba09b281 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:49.884998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71ba3be9-97d8-4868-a9cf-b49fba09b281 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:49.885484 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71ba3be9-97d8-4868-a9cf-b49fba09b281 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:50.097032 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-71ba3be9-97d8-4868-a9cf-b49fba09b281 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 18997 microversion: 2.20 time: 0.228715 Feb 17 03:27:50.097758 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 106/224] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:49 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 18997 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:27:50.295345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-775cc827-c572-4778-bb38-57ea566bceda tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:50.296067 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-775cc827-c572-4778-bb38-57ea566bceda tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:50.304266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-775cc827-c572-4778-bb38-57ea566bceda tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:50.304776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-775cc827-c572-4778-bb38-57ea566bceda tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:50.305606 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-775cc827-c572-4778-bb38-57ea566bceda tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:50.306094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-775cc827-c572-4778-bb38-57ea566bceda tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:50.308973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f8f5e196-c520-439c-94ca-088226783458 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:50.309726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f8f5e196-c520-439c-94ca-088226783458 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:50.318207 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8f5e196-c520-439c-94ca-088226783458 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:50.318702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8f5e196-c520-439c-94ca-088226783458 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:50.319521 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8f5e196-c520-439c-94ca-088226783458 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:50.320022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8f5e196-c520-439c-94ca-088226783458 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:50.622165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-775cc827-c572-4778-bb38-57ea566bceda tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:50.631994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f8f5e196-c520-439c-94ca-088226783458 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:50.632159 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-775cc827-c572-4778-bb38-57ea566bceda tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1314 microversion: 2.1 time: 0.341639 Feb 17 03:27:50.633025 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 119/225] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:50 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:50.641511 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f8f5e196-c520-439c-94ca-088226783458 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.337031 Feb 17 03:27:50.642220 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 107/226] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:50 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:50.855794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-05a354ce-e0cd-4699-ba14-4ec11b456804 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:50.856919 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-05a354ce-e0cd-4699-ba14-4ec11b456804 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:50.870313 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-05a354ce-e0cd-4699-ba14-4ec11b456804 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:50.871183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-05a354ce-e0cd-4699-ba14-4ec11b456804 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:50.872797 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-05a354ce-e0cd-4699-ba14-4ec11b456804 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:50.873667 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-05a354ce-e0cd-4699-ba14-4ec11b456804 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:50.877377 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-066361eb-e1c6-4c2e-b9ff-8c1ed828cfc3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:50.878041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-066361eb-e1c6-4c2e-b9ff-8c1ed828cfc3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:50.889573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-066361eb-e1c6-4c2e-b9ff-8c1ed828cfc3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:50.890318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-066361eb-e1c6-4c2e-b9ff-8c1ed828cfc3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:50.891284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-066361eb-e1c6-4c2e-b9ff-8c1ed828cfc3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:50.891951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-066361eb-e1c6-4c2e-b9ff-8c1ed828cfc3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.072955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-05a354ce-e0cd-4699-ba14-4ec11b456804 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 14 microversion: 2.1 time: 0.222936 Feb 17 03:27:51.077291 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 120/227] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:50 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:27:51.110309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-abca99f1-e854-47d2-882c-fab4329e74a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:51.111592 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-abca99f1-e854-47d2-882c-fab4329e74a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:51.135828 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-abca99f1-e854-47d2-882c-fab4329e74a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.136732 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-abca99f1-e854-47d2-882c-fab4329e74a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.140824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-abca99f1-e854-47d2-882c-fab4329e74a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.141457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-abca99f1-e854-47d2-882c-fab4329e74a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.146723 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-066361eb-e1c6-4c2e-b9ff-8c1ed828cfc3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:51.162976 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-066361eb-e1c6-4c2e-b9ff-8c1ed828cfc3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1508 microversion: 2.1 time: 0.289374 Feb 17 03:27:51.163599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 108/228] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:50 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:51.180595 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1d50f579-b9e7-4e64-94b0-e64d4a116cc0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad8c6fb7-59f0-42de-a526-099608a14ad3"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:51.182236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1d50f579-b9e7-4e64-94b0-e64d4a116cc0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:51.200102 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d50f579-b9e7-4e64-94b0-e64d4a116cc0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.213323 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d50f579-b9e7-4e64-94b0-e64d4a116cc0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.223377 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d50f579-b9e7-4e64-94b0-e64d4a116cc0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.224106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d50f579-b9e7-4e64-94b0-e64d4a116cc0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.379833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-abca99f1-e854-47d2-882c-fab4329e74a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 19827 microversion: 2.20 time: 0.273548 Feb 17 03:27:51.381679 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 121/229] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:51 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 19827 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:27:51.443190 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-1d50f579-b9e7-4e64-94b0-e64d4a116cc0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] HTTP exception thrown: Invalid volume: volume ad8c6fb7-59f0-42de-a526-099608a14ad3 is already attached to instances: b1d0cd30-d2db-45c4-b0f0-35a3d1397131 Feb 17 03:27:51.443865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1d50f579-b9e7-4e64-94b0-e64d4a116cc0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Returning 400 to user: Invalid volume: volume ad8c6fb7-59f0-42de-a526-099608a14ad3 is already attached to instances: b1d0cd30-d2db-45c4-b0f0-35a3d1397131 {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:27:51.444763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1d50f579-b9e7-4e64-94b0-e64d4a116cc0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "POST /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.268330 Feb 17 03:27:51.445541 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 109/230] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:27:51 2021] POST /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7/os-volume_attachments => generated 174 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 17 03:27:51.562341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b4842012-fec3-4a63-8116-71cefe192bbb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:51.563167 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b4842012-fec3-4a63-8116-71cefe192bbb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:51.573301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4842012-fec3-4a63-8116-71cefe192bbb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.574133 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4842012-fec3-4a63-8116-71cefe192bbb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.575263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4842012-fec3-4a63-8116-71cefe192bbb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.576631 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4842012-fec3-4a63-8116-71cefe192bbb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.650551 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1145d88a-3e95-4689-85a8-398eb08aa17c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:51.651575 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1145d88a-3e95-4689-85a8-398eb08aa17c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:51.660931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1145d88a-3e95-4689-85a8-398eb08aa17c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.661743 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1145d88a-3e95-4689-85a8-398eb08aa17c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.662794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1145d88a-3e95-4689-85a8-398eb08aa17c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.663483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1145d88a-3e95-4689-85a8-398eb08aa17c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.793553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-b4842012-fec3-4a63-8116-71cefe192bbb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lazy-loading 'services' on Instance uuid b1d0cd30-d2db-45c4-b0f0-35a3d1397131 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:27:51.957129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b4842012-fec3-4a63-8116-71cefe192bbb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131/os-volume_attachments/ad8c6fb7-59f0-42de-a526-099608a14ad3" status: 202 len: 0 microversion: 2.1 time: 0.399825 Feb 17 03:27:51.958015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 122/231] 10.222.0.46 () {58 vars in 1406 bytes} [Wed Feb 17 03:27:51 2021] DELETE /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131/os-volume_attachments/ad8c6fb7-59f0-42de-a526-099608a14ad3 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:27:51.963536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1145d88a-3e95-4689-85a8-398eb08aa17c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:51.965930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b5effc91-25e6-4dc8-9fc1-915c9ffb7c27 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:51.966698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b5effc91-25e6-4dc8-9fc1-915c9ffb7c27 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:51.977452 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5effc91-25e6-4dc8-9fc1-915c9ffb7c27 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.978128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5effc91-25e6-4dc8-9fc1-915c9ffb7c27 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.979004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5effc91-25e6-4dc8-9fc1-915c9ffb7c27 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.979469 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5effc91-25e6-4dc8-9fc1-915c9ffb7c27 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.991085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1145d88a-3e95-4689-85a8-398eb08aa17c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1314 microversion: 2.1 time: 0.344533 Feb 17 03:27:51.992782 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 110/232] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:51 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:51.999225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-6ffde0c5-9df0-434d-a264-dfe344210fcf req-4fcdbf46-a88f-4eff-989a-bcd62d5e170d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247ca850-da30-4c84-9958-40dd68c23715", "name": "network-vif-plugged", "status": "completed", "tag": "f9cb44e1-39e1-42b7-8141-01ff54d40c3a"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:52.001586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:52.001586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:27:52.014165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-6ffde0c5-9df0-434d-a264-dfe344210fcf req-4fcdbf46-a88f-4eff-989a-bcd62d5e170d service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:52.015066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-6ffde0c5-9df0-434d-a264-dfe344210fcf req-4fcdbf46-a88f-4eff-989a-bcd62d5e170d service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:52.037175 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-6ffde0c5-9df0-434d-a264-dfe344210fcf req-4fcdbf46-a88f-4eff-989a-bcd62d5e170d service nova] Creating event network-vif-plugged:f9cb44e1-39e1-42b7-8141-01ff54d40c3a for instance 247ca850-da30-4c84-9958-40dd68c23715 on hv-cinder-75996 Feb 17 03:27:52.044007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-6ffde0c5-9df0-434d-a264-dfe344210fcf req-4fcdbf46-a88f-4eff-989a-bcd62d5e170d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049296 Feb 17 03:27:52.045548 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 111/233] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:52.087600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-699f3906-0e97-42eb-9054-8430b45bf48d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:52.088713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-699f3906-0e97-42eb-9054-8430b45bf48d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:52.126263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-699f3906-0e97-42eb-9054-8430b45bf48d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:52.126836 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-699f3906-0e97-42eb-9054-8430b45bf48d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:52.130831 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-699f3906-0e97-42eb-9054-8430b45bf48d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:52.133447 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-699f3906-0e97-42eb-9054-8430b45bf48d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:52.302302 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b5effc91-25e6-4dc8-9fc1-915c9ffb7c27 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:52.314630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b5effc91-25e6-4dc8-9fc1-915c9ffb7c27 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.355111 Feb 17 03:27:52.315898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 123/234] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:51 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:52.393446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e66bb3b1-bc22-4bd3-a4f4-007b90788488 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:52.394563 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e66bb3b1-bc22-4bd3-a4f4-007b90788488 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:52.402591 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e66bb3b1-bc22-4bd3-a4f4-007b90788488 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:52.403100 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e66bb3b1-bc22-4bd3-a4f4-007b90788488 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:52.404478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e66bb3b1-bc22-4bd3-a4f4-007b90788488 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:52.404968 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e66bb3b1-bc22-4bd3-a4f4-007b90788488 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:52.428617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-699f3906-0e97-42eb-9054-8430b45bf48d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 6964 microversion: 2.1 time: 0.346891 Feb 17 03:27:52.438665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 112/235] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:52 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 6964 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:52.631546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e66bb3b1-bc22-4bd3-a4f4-007b90788488 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 21625 microversion: 2.20 time: 0.241910 Feb 17 03:27:52.632516 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 124/236] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:52 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 21625 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:27:53.015701 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d45dea0c-03b7-4e35-9347-70be9e5a8444 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:53.016458 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d45dea0c-03b7-4e35-9347-70be9e5a8444 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:53.030619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d45dea0c-03b7-4e35-9347-70be9e5a8444 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:53.031224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d45dea0c-03b7-4e35-9347-70be9e5a8444 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:53.031981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d45dea0c-03b7-4e35-9347-70be9e5a8444 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:53.032467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d45dea0c-03b7-4e35-9347-70be9e5a8444 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:53.337746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c78b4aa4-ce6b-4520-9534-0313c9b4b4db tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:53.338737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c78b4aa4-ce6b-4520-9534-0313c9b4b4db tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:53.344013 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d45dea0c-03b7-4e35-9347-70be9e5a8444 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:53.350371 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c78b4aa4-ce6b-4520-9534-0313c9b4b4db tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:53.351076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c78b4aa4-ce6b-4520-9534-0313c9b4b4db tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:53.352232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c78b4aa4-ce6b-4520-9534-0313c9b4b4db tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:53.352906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c78b4aa4-ce6b-4520-9534-0313c9b4b4db tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:53.354148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d45dea0c-03b7-4e35-9347-70be9e5a8444 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1314 microversion: 2.1 time: 0.344729 Feb 17 03:27:53.354763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 113/237] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:53 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:53.455579 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-058d5690-b4dc-48da-a357-eb5a466c5889 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:53.458131 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-058d5690-b4dc-48da-a357-eb5a466c5889 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:53.479124 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-058d5690-b4dc-48da-a357-eb5a466c5889 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:53.479786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-058d5690-b4dc-48da-a357-eb5a466c5889 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:53.481806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-058d5690-b4dc-48da-a357-eb5a466c5889 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:53.483203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-058d5690-b4dc-48da-a357-eb5a466c5889 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:53.608854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c78b4aa4-ce6b-4520-9534-0313c9b4b4db tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:53.617839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c78b4aa4-ce6b-4520-9534-0313c9b4b4db tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.288574 Feb 17 03:27:53.629745 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 125/238] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:53 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:53.645672 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-89da1a35-feb4-4203-9204-046635e723aa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:53.647102 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-89da1a35-feb4-4203-9204-046635e723aa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:53.656610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89da1a35-feb4-4203-9204-046635e723aa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:53.657909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89da1a35-feb4-4203-9204-046635e723aa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:53.658827 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89da1a35-feb4-4203-9204-046635e723aa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:53.665733 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89da1a35-feb4-4203-9204-046635e723aa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:53.736993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-058d5690-b4dc-48da-a357-eb5a466c5889 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 10830 microversion: 2.1 time: 0.298312 Feb 17 03:27:53.738434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 114/239] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:53 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 10830 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:27:53.890138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-89da1a35-feb4-4203-9204-046635e723aa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 22716 microversion: 2.20 time: 0.248606 Feb 17 03:27:53.891548 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 126/240] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:53 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 22716 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:27:54.372407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-90dc0f83-f6eb-44c2-8777-0e9b411e5acc tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:54.373246 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-90dc0f83-f6eb-44c2-8777-0e9b411e5acc tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:54.381958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-90dc0f83-f6eb-44c2-8777-0e9b411e5acc tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:54.382533 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-90dc0f83-f6eb-44c2-8777-0e9b411e5acc tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:54.383600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-90dc0f83-f6eb-44c2-8777-0e9b411e5acc tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:54.384103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-90dc0f83-f6eb-44c2-8777-0e9b411e5acc tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:54.639215 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-689dbe15-a1a1-4870-9631-466b7128e969 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:54.639991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-689dbe15-a1a1-4870-9631-466b7128e969 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:54.658753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-90dc0f83-f6eb-44c2-8777-0e9b411e5acc tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:54.659640 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-689dbe15-a1a1-4870-9631-466b7128e969 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:54.662270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-689dbe15-a1a1-4870-9631-466b7128e969 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:54.663317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-689dbe15-a1a1-4870-9631-466b7128e969 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:54.665351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-689dbe15-a1a1-4870-9631-466b7128e969 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:54.669494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-90dc0f83-f6eb-44c2-8777-0e9b411e5acc tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1314 microversion: 2.1 time: 0.301583 Feb 17 03:27:54.671549 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 115/241] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:54 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:54.751858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-90952823-ab21-4530-9017-e63c35341422 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:54.752890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-90952823-ab21-4530-9017-e63c35341422 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:54.761230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-90952823-ab21-4530-9017-e63c35341422 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:54.761731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-90952823-ab21-4530-9017-e63c35341422 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:54.762564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-90952823-ab21-4530-9017-e63c35341422 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:54.763042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-90952823-ab21-4530-9017-e63c35341422 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:54.927338 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-689dbe15-a1a1-4870-9631-466b7128e969 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:54.938990 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-689dbe15-a1a1-4870-9631-466b7128e969 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.305853 Feb 17 03:27:54.939993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 127/242] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:54 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:54.945526 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-462ffbae-5eb6-4720-981b-165c490cdd0b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:54.946712 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-462ffbae-5eb6-4720-981b-165c490cdd0b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:54.957234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-462ffbae-5eb6-4720-981b-165c490cdd0b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:54.958500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-462ffbae-5eb6-4720-981b-165c490cdd0b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:54.959816 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-462ffbae-5eb6-4720-981b-165c490cdd0b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:54.960451 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-462ffbae-5eb6-4720-981b-165c490cdd0b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:54.986262 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-90952823-ab21-4530-9017-e63c35341422 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 14402 microversion: 2.1 time: 0.238651 Feb 17 03:27:54.987636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 116/243] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:54 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 14402 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:27:55.182205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-462ffbae-5eb6-4720-981b-165c490cdd0b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 23231 microversion: 2.20 time: 0.240268 Feb 17 03:27:55.183789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 128/244] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:54 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 23231 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:27:55.660521 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2012880728", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "networks": [{"uuid": "14692b9d-40c8-4147-9ef2-2084ebbdc286"}]}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:55.688310 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9c3e62cb-3157-4ce4-8cce-28102b0f9f42 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:55.689295 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9c3e62cb-3157-4ce4-8cce-28102b0f9f42 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:55.708983 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9c3e62cb-3157-4ce4-8cce-28102b0f9f42 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:55.709495 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9c3e62cb-3157-4ce4-8cce-28102b0f9f42 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:55.710349 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9c3e62cb-3157-4ce4-8cce-28102b0f9f42 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:55.710976 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9c3e62cb-3157-4ce4-8cce-28102b0f9f42 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:55.750536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] validate_networks() for [('14692b9d-40c8-4147-9ef2-2084ebbdc286', None, None, None)] {{(pid=98183) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:27:56.157581 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9c3e62cb-3157-4ce4-8cce-28102b0f9f42 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:56.170475 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9c3e62cb-3157-4ce4-8cce-28102b0f9f42 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1498 microversion: 2.1 time: 0.486740 Feb 17 03:27:56.171367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 129/245] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:55 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1498 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:56.179795 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bf4d97cf-bf9d-4739-a02c-3c5d6e2ca322 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:56.180636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bf4d97cf-bf9d-4739-a02c-3c5d6e2ca322 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:56.191301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf4d97cf-bf9d-4739-a02c-3c5d6e2ca322 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.192174 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf4d97cf-bf9d-4739-a02c-3c5d6e2ca322 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:56.193739 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf4d97cf-bf9d-4739-a02c-3c5d6e2ca322 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.194412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf4d97cf-bf9d-4739-a02c-3c5d6e2ca322 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:56.615889 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bf4d97cf-bf9d-4739-a02c-3c5d6e2ca322 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:56.628560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bf4d97cf-bf9d-4739-a02c-3c5d6e2ca322 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.454500 Feb 17 03:27:56.630164 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 130/246] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:56 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:56.644799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d5c3ae67-5af1-4755-aa27-5e9e6af18661 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:56.646093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d5c3ae67-5af1-4755-aa27-5e9e6af18661 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:56.658855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d5c3ae67-5af1-4755-aa27-5e9e6af18661 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.659578 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d5c3ae67-5af1-4755-aa27-5e9e6af18661 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:56.661998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d5c3ae67-5af1-4755-aa27-5e9e6af18661 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.662994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d5c3ae67-5af1-4755-aa27-5e9e6af18661 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:56.699125 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Flavor limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:27:56.699988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Image limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:27:56.700752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Flavor pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:27:56.701395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Image pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:27:56.702034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:27:56.716197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.717465 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:56.718489 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.720768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:56.758559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Getting quotas for project 0ade3597251b451eb7a31a1c95528adf. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:56.763865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Getting quotas for user 41a15644050d496c9d4a641eb5f8f088 and project 0ade3597251b451eb7a31a1c95528adf. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:56.785258 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Going to run 1 instances... {{(pid=98183) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:27:56.788233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:27:56.852501 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d5c3ae67-5af1-4755-aa27-5e9e6af18661 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 17861 microversion: 2.1 time: 0.220444 Feb 17 03:27:56.853704 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 131/247] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:56 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 17861 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:27:56.861467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a274fe42-d47c-44d4-b279-835b91386fdb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:56.862799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a274fe42-d47c-44d4-b279-835b91386fdb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:56.875909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a274fe42-d47c-44d4-b279-835b91386fdb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.876579 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a274fe42-d47c-44d4-b279-835b91386fdb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:56.877613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a274fe42-d47c-44d4-b279-835b91386fdb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.879598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a274fe42-d47c-44d4-b279-835b91386fdb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:56.883728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4636bbec-4455-4394-8d93-34ba50fb2729 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230397 Feb 17 03:27:56.897130 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 117/248] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:27:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:27:56.907925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c024b0a6-e680-4ccf-9fe5-7c6860a1f540 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:56.909002 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c024b0a6-e680-4ccf-9fe5-7c6860a1f540 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:57.022363 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c024b0a6-e680-4ccf-9fe5-7c6860a1f540 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:57.032148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c024b0a6-e680-4ccf-9fe5-7c6860a1f540 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1218 microversion: 2.1 time: 0.133838 Feb 17 03:27:57.032750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 118/249] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:56 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:57.070583 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a274fe42-d47c-44d4-b279-835b91386fdb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 24268 microversion: 2.20 time: 0.215219 Feb 17 03:27:57.071955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 132/250] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:56 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 24268 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:27:57.427229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a98d0e2a-54b5-4719-9d97-6cc0b81f87cb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:57.428070 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a98d0e2a-54b5-4719-9d97-6cc0b81f87cb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:57.447384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a98d0e2a-54b5-4719-9d97-6cc0b81f87cb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:57.447924 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a98d0e2a-54b5-4719-9d97-6cc0b81f87cb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:57.448780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a98d0e2a-54b5-4719-9d97-6cc0b81f87cb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:57.449271 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a98d0e2a-54b5-4719-9d97-6cc0b81f87cb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:57.564316 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a98d0e2a-54b5-4719-9d97-6cc0b81f87cb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Going to try to terminate instance {{(pid=98183) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:27:57.649815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-09d1fd63-3df7-4500-b607-10b3aea386be tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:57.650948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-09d1fd63-3df7-4500-b607-10b3aea386be tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:57.662781 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-09d1fd63-3df7-4500-b607-10b3aea386be tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:57.663394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-09d1fd63-3df7-4500-b607-10b3aea386be tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:57.664470 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-09d1fd63-3df7-4500-b607-10b3aea386be tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:57.665147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-09d1fd63-3df7-4500-b607-10b3aea386be tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:57.689594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a98d0e2a-54b5-4719-9d97-6cc0b81f87cb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "DELETE /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 204 len: 0 microversion: 2.1 time: 0.266492 Feb 17 03:27:57.690234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 119/251] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:27:57 2021] DELETE /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:27:57.701683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4aa0fff4-b5cf-47e4-80ed-34d42cee34b9 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:57.702457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4aa0fff4-b5cf-47e4-80ed-34d42cee34b9 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:57.713166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4aa0fff4-b5cf-47e4-80ed-34d42cee34b9 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:57.713828 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4aa0fff4-b5cf-47e4-80ed-34d42cee34b9 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:57.715417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4aa0fff4-b5cf-47e4-80ed-34d42cee34b9 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:57.716076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4aa0fff4-b5cf-47e4-80ed-34d42cee34b9 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:58.016656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4aa0fff4-b5cf-47e4-80ed-34d42cee34b9 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:58.022061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-09d1fd63-3df7-4500-b607-10b3aea386be tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:58.028200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4aa0fff4-b5cf-47e4-80ed-34d42cee34b9 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1504 microversion: 2.1 time: 0.333044 Feb 17 03:27:58.029052 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 120/252] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:57 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:58.031929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-09d1fd63-3df7-4500-b607-10b3aea386be tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.388558 Feb 17 03:27:58.032580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 133/253] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:57 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:58.040491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d00f3bfd-7461-4fc2-9f97-9c3cd8d24d59 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:58.041598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d00f3bfd-7461-4fc2-9f97-9c3cd8d24d59 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:58.050336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d00f3bfd-7461-4fc2-9f97-9c3cd8d24d59 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:58.050829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d00f3bfd-7461-4fc2-9f97-9c3cd8d24d59 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:58.050939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e018d394-8a80-445d-a246-c6502cb97314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:58.051498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e018d394-8a80-445d-a246-c6502cb97314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:58.051793 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d00f3bfd-7461-4fc2-9f97-9c3cd8d24d59 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:58.052272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d00f3bfd-7461-4fc2-9f97-9c3cd8d24d59 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:58.060231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e018d394-8a80-445d-a246-c6502cb97314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:58.060231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e018d394-8a80-445d-a246-c6502cb97314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:58.060996 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e018d394-8a80-445d-a246-c6502cb97314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:58.061485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e018d394-8a80-445d-a246-c6502cb97314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:58.190586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e018d394-8a80-445d-a246-c6502cb97314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:58.199417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e018d394-8a80-445d-a246-c6502cb97314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1270 microversion: 2.1 time: 0.152691 Feb 17 03:27:58.200461 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 134/254] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:58 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:58.206214 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-23bd558f-ece5-486d-80a1-fe240471eb0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:58.207240 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-23bd558f-ece5-486d-80a1-fe240471eb0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:58.216072 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23bd558f-ece5-486d-80a1-fe240471eb0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:58.216623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23bd558f-ece5-486d-80a1-fe240471eb0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:58.217493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23bd558f-ece5-486d-80a1-fe240471eb0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:58.217988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23bd558f-ece5-486d-80a1-fe240471eb0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:58.241222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d00f3bfd-7461-4fc2-9f97-9c3cd8d24d59 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 17861 microversion: 2.1 time: 0.203827 Feb 17 03:27:58.243000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 121/255] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:58 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 17861 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:27:58.412517 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-23bd558f-ece5-486d-80a1-fe240471eb0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 25070 microversion: 2.20 time: 0.210041 Feb 17 03:27:58.415454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 135/256] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:58 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 25070 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:27:59.051148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f140c31d-3008-4c5b-b36e-0939972a05f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:59.055193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f140c31d-3008-4c5b-b36e-0939972a05f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:59.056096 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d1581c04-e320-4add-a3ad-36b5bb754534 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:59.060058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d1581c04-e320-4add-a3ad-36b5bb754534 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:59.076210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f140c31d-3008-4c5b-b36e-0939972a05f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:59.076802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f140c31d-3008-4c5b-b36e-0939972a05f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:59.077783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f140c31d-3008-4c5b-b36e-0939972a05f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:59.078078 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d1581c04-e320-4add-a3ad-36b5bb754534 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:59.078643 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f140c31d-3008-4c5b-b36e-0939972a05f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:59.079250 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d1581c04-e320-4add-a3ad-36b5bb754534 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:59.086366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d1581c04-e320-4add-a3ad-36b5bb754534 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:59.087151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d1581c04-e320-4add-a3ad-36b5bb754534 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:59.762279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f140c31d-3008-4c5b-b36e-0939972a05f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:59.775782 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d1581c04-e320-4add-a3ad-36b5bb754534 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:59.785560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d1581c04-e320-4add-a3ad-36b5bb754534 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1504 microversion: 2.1 time: 0.742633 Feb 17 03:27:59.791609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 122/257] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:59 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1504 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:59.791799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f140c31d-3008-4c5b-b36e-0939972a05f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.740337 Feb 17 03:27:59.791799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 136/258] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:59 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:59.792708 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6707a4fb-e1c6-466f-b786-1ef2b5058c5e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:59.793744 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6707a4fb-e1c6-466f-b786-1ef2b5058c5e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:59.800157 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-53bb97eb-cf5b-4540-8bb3-8a3b5e30dd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:59.802293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-53bb97eb-cf5b-4540-8bb3-8a3b5e30dd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:59.811999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-53bb97eb-cf5b-4540-8bb3-8a3b5e30dd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:59.812498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-53bb97eb-cf5b-4540-8bb3-8a3b5e30dd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:59.813340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-53bb97eb-cf5b-4540-8bb3-8a3b5e30dd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:59.813823 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-53bb97eb-cf5b-4540-8bb3-8a3b5e30dd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:59.826499 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6707a4fb-e1c6-466f-b786-1ef2b5058c5e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:59.827011 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6707a4fb-e1c6-466f-b786-1ef2b5058c5e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:59.827902 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6707a4fb-e1c6-466f-b786-1ef2b5058c5e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:59.828392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6707a4fb-e1c6-466f-b786-1ef2b5058c5e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:59.980932 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-53bb97eb-cf5b-4540-8bb3-8a3b5e30dd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:59.992204 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-53bb97eb-cf5b-4540-8bb3-8a3b5e30dd65 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1276 microversion: 2.1 time: 0.204175 Feb 17 03:27:59.993128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 123/259] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:59 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1276 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:59.999467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3d2f48bd-b449-4272-9578-2d9e83d60c98 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:00.000773 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3d2f48bd-b449-4272-9578-2d9e83d60c98 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:00.009294 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d2f48bd-b449-4272-9578-2d9e83d60c98 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:00.010094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d2f48bd-b449-4272-9578-2d9e83d60c98 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:00.011137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d2f48bd-b449-4272-9578-2d9e83d60c98 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:00.012172 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d2f48bd-b449-4272-9578-2d9e83d60c98 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:00.107916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6707a4fb-e1c6-466f-b786-1ef2b5058c5e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 19342 microversion: 2.1 time: 0.318087 Feb 17 03:28:00.109888 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 137/260] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:27:59 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 19342 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:00.410094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3d2f48bd-b449-4272-9578-2d9e83d60c98 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 25991 microversion: 2.20 time: 0.411375 Feb 17 03:28:00.411050 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 124/261] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:27:59 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 25991 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:00.806524 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d7a03b0d-aaed-44b5-b78b-4c2e56ad3934 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:00.807320 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e41175df-32de-4470-889a-af8959a2abfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:00.807746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d7a03b0d-aaed-44b5-b78b-4c2e56ad3934 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:00.808113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e41175df-32de-4470-889a-af8959a2abfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:00.818191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7a03b0d-aaed-44b5-b78b-4c2e56ad3934 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:00.818333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e41175df-32de-4470-889a-af8959a2abfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:00.818838 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e41175df-32de-4470-889a-af8959a2abfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:00.819201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7a03b0d-aaed-44b5-b78b-4c2e56ad3934 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:00.819723 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e41175df-32de-4470-889a-af8959a2abfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:00.820342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e41175df-32de-4470-889a-af8959a2abfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:00.820799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7a03b0d-aaed-44b5-b78b-4c2e56ad3934 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:00.821076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7a03b0d-aaed-44b5-b78b-4c2e56ad3934 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:01.421920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e41175df-32de-4470-889a-af8959a2abfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:01.440571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e41175df-32de-4470-889a-af8959a2abfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.638577 Feb 17 03:28:01.451247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 125/262] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:00 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:01.458489 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d7a03b0d-aaed-44b5-b78b-4c2e56ad3934 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:01.470526 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d7a03b0d-aaed-44b5-b78b-4c2e56ad3934 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1504 microversion: 2.1 time: 0.668362 Feb 17 03:28:01.471137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 138/263] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:00 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1504 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:01.482108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e66a8010-abe6-42a9-984c-a0398c1f17a8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:01.482936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e66a8010-abe6-42a9-984c-a0398c1f17a8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:01.488239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f97eb4bd-533e-42e4-9b6e-6d3d8aff51a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:01.497163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f97eb4bd-533e-42e4-9b6e-6d3d8aff51a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:01.502751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e66a8010-abe6-42a9-984c-a0398c1f17a8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:01.503429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e66a8010-abe6-42a9-984c-a0398c1f17a8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:01.504480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e66a8010-abe6-42a9-984c-a0398c1f17a8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:01.505115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e66a8010-abe6-42a9-984c-a0398c1f17a8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:01.517447 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f97eb4bd-533e-42e4-9b6e-6d3d8aff51a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:01.518176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f97eb4bd-533e-42e4-9b6e-6d3d8aff51a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:01.519182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f97eb4bd-533e-42e4-9b6e-6d3d8aff51a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:01.520793 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f97eb4bd-533e-42e4-9b6e-6d3d8aff51a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:01.801375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f97eb4bd-533e-42e4-9b6e-6d3d8aff51a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 21337 microversion: 2.1 time: 0.316561 Feb 17 03:28:01.802245 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 139/264] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:01 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 21337 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:01.807941 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9e664d86-a6e4-41d0-bd1a-4a0abd152da8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:01.815454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9e664d86-a6e4-41d0-bd1a-4a0abd152da8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:01.832912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e664d86-a6e4-41d0-bd1a-4a0abd152da8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:01.833572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e664d86-a6e4-41d0-bd1a-4a0abd152da8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:01.834753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e664d86-a6e4-41d0-bd1a-4a0abd152da8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:01.835412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e664d86-a6e4-41d0-bd1a-4a0abd152da8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:02.030680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9e664d86-a6e4-41d0-bd1a-4a0abd152da8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 26612 microversion: 2.20 time: 0.226693 Feb 17 03:28:02.032099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 140/265] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:01 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 26612 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:02.097610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-3addfe3d-5369-4cd6-a403-c28143bfdfbb req-d9431e80-e490-4dbd-b523-0aec334dd0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed401356-e52d-44a1-aa8a-96252fd9cc98", "tag": "5e72f71c-333a-4cfd-859b-95ac38dfea5f"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:02.099656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:02.099656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:28:02.114249 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-3addfe3d-5369-4cd6-a403-c28143bfdfbb req-d9431e80-e490-4dbd-b523-0aec334dd0a4 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:02.115109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-3addfe3d-5369-4cd6-a403-c28143bfdfbb req-d9431e80-e490-4dbd-b523-0aec334dd0a4 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:02.140221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-3addfe3d-5369-4cd6-a403-c28143bfdfbb req-d9431e80-e490-4dbd-b523-0aec334dd0a4 service nova] Creating event network-changed:5e72f71c-333a-4cfd-859b-95ac38dfea5f for instance ed401356-e52d-44a1-aa8a-96252fd9cc98 on hv-cinder-75996 Feb 17 03:28:02.145448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-3addfe3d-5369-4cd6-a403-c28143bfdfbb req-d9431e80-e490-4dbd-b523-0aec334dd0a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055268 Feb 17 03:28:02.146414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 141/266] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:28:02.168379 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e66a8010-abe6-42a9-984c-a0398c1f17a8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:02.179446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e66a8010-abe6-42a9-984c-a0398c1f17a8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1318 microversion: 2.1 time: 0.726608 Feb 17 03:28:02.180745 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 126/267] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:01 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1318 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:02.267871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-336f6d4c-ca44-4df9-bb10-92b01579f938 req-e896fe16-29f0-4b44-94c1-6097def04a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247ca850-da30-4c84-9958-40dd68c23715", "name": "network-vif-unplugged", "status": "completed", "tag": "f9cb44e1-39e1-42b7-8141-01ff54d40c3a"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:02.269488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:02.269488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:28:02.296508 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-336f6d4c-ca44-4df9-bb10-92b01579f938 req-e896fe16-29f0-4b44-94c1-6097def04a65 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:02.296979 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-336f6d4c-ca44-4df9-bb10-92b01579f938 req-e896fe16-29f0-4b44-94c1-6097def04a65 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:02.341076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-336f6d4c-ca44-4df9-bb10-92b01579f938 req-e896fe16-29f0-4b44-94c1-6097def04a65 service nova] Creating event network-vif-unplugged:f9cb44e1-39e1-42b7-8141-01ff54d40c3a for instance 247ca850-da30-4c84-9958-40dd68c23715 on hv-cinder-75996 Feb 17 03:28:02.360091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-336f6d4c-ca44-4df9-bb10-92b01579f938 req-e896fe16-29f0-4b44-94c1-6097def04a65 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097381 Feb 17 03:28:02.362501 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 142/268] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:02 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:02.461065 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-eedce0e7-883e-418c-bf1f-8da48c104db0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:02.461816 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-eedce0e7-883e-418c-bf1f-8da48c104db0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:02.490556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4112eeef-5c72-4420-93db-ba3d6616b22a tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:02.491975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4112eeef-5c72-4420-93db-ba3d6616b22a tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:02.497690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eedce0e7-883e-418c-bf1f-8da48c104db0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:02.498288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eedce0e7-883e-418c-bf1f-8da48c104db0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:02.499813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eedce0e7-883e-418c-bf1f-8da48c104db0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:02.511831 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eedce0e7-883e-418c-bf1f-8da48c104db0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:02.512411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4112eeef-5c72-4420-93db-ba3d6616b22a tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:02.515344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4112eeef-5c72-4420-93db-ba3d6616b22a tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:02.515344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4112eeef-5c72-4420-93db-ba3d6616b22a tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:02.515344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4112eeef-5c72-4420-93db-ba3d6616b22a tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:03.047250 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-eedce0e7-883e-418c-bf1f-8da48c104db0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:03.060567 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-eedce0e7-883e-418c-bf1f-8da48c104db0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.605774 Feb 17 03:28:03.062584 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 127/269] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:02 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:03.068363 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-73ddbf7d-80ac-4700-a394-b16a32ba05e8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:03.069481 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-73ddbf7d-80ac-4700-a394-b16a32ba05e8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:03.083753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73ddbf7d-80ac-4700-a394-b16a32ba05e8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:03.084377 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73ddbf7d-80ac-4700-a394-b16a32ba05e8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:03.085103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73ddbf7d-80ac-4700-a394-b16a32ba05e8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:03.085594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73ddbf7d-80ac-4700-a394-b16a32ba05e8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:03.116757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4112eeef-5c72-4420-93db-ba3d6616b22a tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:03.132350 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4112eeef-5c72-4420-93db-ba3d6616b22a tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1504 microversion: 2.1 time: 0.646737 Feb 17 03:28:03.133849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 143/270] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:02 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1504 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:03.140123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4938519f-2c8e-49b5-b7e1-046ef5fc6eda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:03.141241 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4938519f-2c8e-49b5-b7e1-046ef5fc6eda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:03.149676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4938519f-2c8e-49b5-b7e1-046ef5fc6eda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:03.150445 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4938519f-2c8e-49b5-b7e1-046ef5fc6eda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:03.151370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4938519f-2c8e-49b5-b7e1-046ef5fc6eda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:03.151969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4938519f-2c8e-49b5-b7e1-046ef5fc6eda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:03.353806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-73ddbf7d-80ac-4700-a394-b16a32ba05e8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 22957 microversion: 2.1 time: 0.289410 Feb 17 03:28:03.355249 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 128/271] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:03 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 22957 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:03.362527 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-33c8e0fd-93c3-45f9-a34f-ca12d03e2fab tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:03.363770 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-33c8e0fd-93c3-45f9-a34f-ca12d03e2fab tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:03.378179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-33c8e0fd-93c3-45f9-a34f-ca12d03e2fab tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:03.379020 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-33c8e0fd-93c3-45f9-a34f-ca12d03e2fab tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:03.380098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-33c8e0fd-93c3-45f9-a34f-ca12d03e2fab tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:03.380955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-33c8e0fd-93c3-45f9-a34f-ca12d03e2fab tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:03.429615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4938519f-2c8e-49b5-b7e1-046ef5fc6eda tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 27103 microversion: 2.20 time: 0.294516 Feb 17 03:28:03.435883 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 144/272] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:03 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 27103 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:03.910709 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-33c8e0fd-93c3-45f9-a34f-ca12d03e2fab tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:03.921027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-33c8e0fd-93c3-45f9-a34f-ca12d03e2fab tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1318 microversion: 2.1 time: 0.564162 Feb 17 03:28:03.921869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 129/273] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:03 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1318 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:04.082894 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-36967525-23fe-4f28-85fb-61e5665a9282 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:04.083708 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-36967525-23fe-4f28-85fb-61e5665a9282 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:04.094246 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-36967525-23fe-4f28-85fb-61e5665a9282 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.094770 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-36967525-23fe-4f28-85fb-61e5665a9282 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.095906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-36967525-23fe-4f28-85fb-61e5665a9282 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.096400 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-36967525-23fe-4f28-85fb-61e5665a9282 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.153361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1c391739-e163-4162-8812-024ed17959ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:04.154244 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1c391739-e163-4162-8812-024ed17959ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:04.164913 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1c391739-e163-4162-8812-024ed17959ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.165587 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1c391739-e163-4162-8812-024ed17959ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.166557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1c391739-e163-4162-8812-024ed17959ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.167155 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1c391739-e163-4162-8812-024ed17959ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.407266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1c391739-e163-4162-8812-024ed17959ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:04.415967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1c391739-e163-4162-8812-024ed17959ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 200 len: 1462 microversion: 2.1 time: 0.268165 Feb 17 03:28:04.424120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 130/274] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:04 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 1462 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:04.431262 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-3b79cc11-c86a-4897-8054-6974fa68a7ce req-d66b7ea9-b11a-4d5f-8a26-ff44fbcd37ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247ca850-da30-4c84-9958-40dd68c23715", "name": "network-vif-deleted", "tag": "f9cb44e1-39e1-42b7-8141-01ff54d40c3a"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:04.433004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:04.433004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:28:04.455216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-3b79cc11-c86a-4897-8054-6974fa68a7ce req-d66b7ea9-b11a-4d5f-8a26-ff44fbcd37ea service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.456376 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-3b79cc11-c86a-4897-8054-6974fa68a7ce req-d66b7ea9-b11a-4d5f-8a26-ff44fbcd37ea service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.475144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-3b79cc11-c86a-4897-8054-6974fa68a7ce req-d66b7ea9-b11a-4d5f-8a26-ff44fbcd37ea service nova] Creating event network-vif-deleted:f9cb44e1-39e1-42b7-8141-01ff54d40c3a for instance 247ca850-da30-4c84-9958-40dd68c23715 on hv-cinder-75996 Feb 17 03:28:04.481228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-3b79cc11-c86a-4897-8054-6974fa68a7ce req-d66b7ea9-b11a-4d5f-8a26-ff44fbcd37ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054927 Feb 17 03:28:04.481968 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 131/275] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:04.493025 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2680c051-ca1f-4264-a88f-a901ab18718b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:04.494411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2680c051-ca1f-4264-a88f-a901ab18718b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:04.506572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2680c051-ca1f-4264-a88f-a901ab18718b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.507633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2680c051-ca1f-4264-a88f-a901ab18718b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.509347 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2680c051-ca1f-4264-a88f-a901ab18718b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.509849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2680c051-ca1f-4264-a88f-a901ab18718b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.712128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-36967525-23fe-4f28-85fb-61e5665a9282 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:04.715992 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2680c051-ca1f-4264-a88f-a901ab18718b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 23597 microversion: 2.1 time: 0.231930 Feb 17 03:28:04.718038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 132/276] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:04 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 23597 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:04.724628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ba7eebc6-a1c5-4dce-a7b8-cc90c704ee7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:04.726326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ba7eebc6-a1c5-4dce-a7b8-cc90c704ee7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:04.729283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-36967525-23fe-4f28-85fb-61e5665a9282 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.652667 Feb 17 03:28:04.729869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 145/277] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:04 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:04.736664 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ba7eebc6-a1c5-4dce-a7b8-cc90c704ee7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.737621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ba7eebc6-a1c5-4dce-a7b8-cc90c704ee7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.738107 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ba7eebc6-a1c5-4dce-a7b8-cc90c704ee7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.738588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ba7eebc6-a1c5-4dce-a7b8-cc90c704ee7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.939009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cfab7481-d154-451c-b974-be9ae0854c93 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:04.939619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cfab7481-d154-451c-b974-be9ae0854c93 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:04.941579 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ba7eebc6-a1c5-4dce-a7b8-cc90c704ee7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 27497 microversion: 2.20 time: 0.221834 Feb 17 03:28:04.942485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 133/278] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:04 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 27497 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:04.947332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cfab7481-d154-451c-b974-be9ae0854c93 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.947859 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cfab7481-d154-451c-b974-be9ae0854c93 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.948680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cfab7481-d154-451c-b974-be9ae0854c93 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.949166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cfab7481-d154-451c-b974-be9ae0854c93 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.165582 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cfab7481-d154-451c-b974-be9ae0854c93 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:05.174828 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cfab7481-d154-451c-b974-be9ae0854c93 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1318 microversion: 2.1 time: 0.240391 Feb 17 03:28:05.175432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 146/279] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:04 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:05.435634 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8f05262d-d9d7-445a-9635-f4eabb823f6b tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:05.436398 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8f05262d-d9d7-445a-9635-f4eabb823f6b tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: 247ca850-da30-4c84-9958-40dd68c23715] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:05.444921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8f05262d-d9d7-445a-9635-f4eabb823f6b tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:05.445420 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8f05262d-d9d7-445a-9635-f4eabb823f6b tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.446293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8f05262d-d9d7-445a-9635-f4eabb823f6b tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:05.446780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8f05262d-d9d7-445a-9635-f4eabb823f6b tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.501872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-8f05262d-d9d7-445a-9635-f4eabb823f6b tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] HTTP exception thrown: Instance 247ca850-da30-4c84-9958-40dd68c23715 could not be found. Feb 17 03:28:05.502455 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8f05262d-d9d7-445a-9635-f4eabb823f6b tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Returning 404 to user: Instance 247ca850-da30-4c84-9958-40dd68c23715 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:28:05.503341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8f05262d-d9d7-445a-9635-f4eabb823f6b tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715" status: 404 len: 111 microversion: 2.1 time: 0.072270 Feb 17 03:28:05.503954 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 134/280] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:05 2021] GET /compute/v2.1/servers/247ca850-da30-4c84-9958-40dd68c23715 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:28:05.623695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-196291059", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "networks": [{"uuid": "b088fa35-a5b7-48ec-81c3-59d2072b22a6"}]}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:05.688789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] validate_networks() for [('b088fa35-a5b7-48ec-81c3-59d2072b22a6', None, None, None)] {{(pid=98184) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:28:05.729426 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b0840b9e-c842-486c-a4c8-c0698b8b0dd6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:05.730458 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b0840b9e-c842-486c-a4c8-c0698b8b0dd6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:05.738299 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0840b9e-c842-486c-a4c8-c0698b8b0dd6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:05.738800 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0840b9e-c842-486c-a4c8-c0698b8b0dd6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.739667 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0840b9e-c842-486c-a4c8-c0698b8b0dd6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:05.740159 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0840b9e-c842-486c-a4c8-c0698b8b0dd6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.997808 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b0840b9e-c842-486c-a4c8-c0698b8b0dd6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 24205 microversion: 2.1 time: 0.267615 Feb 17 03:28:05.997808 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 135/281] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:05 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 24205 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:06.001890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-19823992-25a0-4931-b04e-d1a10005213e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:06.002884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-19823992-25a0-4931-b04e-d1a10005213e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:06.013146 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19823992-25a0-4931-b04e-d1a10005213e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.013718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19823992-25a0-4931-b04e-d1a10005213e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.015170 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19823992-25a0-4931-b04e-d1a10005213e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.015815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19823992-25a0-4931-b04e-d1a10005213e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.350828 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Flavor limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:28:06.351301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Image limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:28:06.351864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Flavor pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:28:06.352326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Image pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:28:06.352827 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:28:06.363058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.363610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.365233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.365233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.374126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-19823992-25a0-4931-b04e-d1a10005213e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:06.383732 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-19823992-25a0-4931-b04e-d1a10005213e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.388593 Feb 17 03:28:06.385871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 136/282] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:05 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:06.386022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Getting quotas for project b4f9108c28e441b4aa6c82ac5f4d640f. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:28:06.390396 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Getting quotas for user 9c1d539ce3f64b8fad9994cf919422a2 and project b4f9108c28e441b4aa6c82ac5f4d640f. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:28:06.390647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ccab480e-6421-4f4b-8881-0821662e7ff1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:06.391850 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ccab480e-6421-4f4b-8881-0821662e7ff1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:06.400545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ccab480e-6421-4f4b-8881-0821662e7ff1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.401278 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ccab480e-6421-4f4b-8881-0821662e7ff1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.402178 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ccab480e-6421-4f4b-8881-0821662e7ff1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.402668 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ccab480e-6421-4f4b-8881-0821662e7ff1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.403827 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Going to run 1 instances... {{(pid=98184) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:28:06.406703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:28:06.458616 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c9ba1ca1-8474-4b0a-b9d4-98da36ce42ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838854 Feb 17 03:28:06.459603 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 147/283] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:28:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:28:06.467921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a8b6828d-df11-4488-945d-3c4851c326f6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:06.468839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a8b6828d-df11-4488-945d-3c4851c326f6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:06.477480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a8b6828d-df11-4488-945d-3c4851c326f6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.478068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a8b6828d-df11-4488-945d-3c4851c326f6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.479068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a8b6828d-df11-4488-945d-3c4851c326f6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.479672 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a8b6828d-df11-4488-945d-3c4851c326f6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.568841 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ccab480e-6421-4f4b-8881-0821662e7ff1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 27684 microversion: 2.20 time: 0.181657 Feb 17 03:28:06.571341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 137/284] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:06 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 27684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:06.577677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8e81a3ff-e80e-485e-b395-4fc0762f929e tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:06.582907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8e81a3ff-e80e-485e-b395-4fc0762f929e tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:06.694675 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8e81a3ff-e80e-485e-b395-4fc0762f929e tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:06.714145 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8e81a3ff-e80e-485e-b395-4fc0762f929e tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1213 microversion: 2.1 time: 0.131472 Feb 17 03:28:06.715147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 138/285] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:06 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1213 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:06.760054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a8b6828d-df11-4488-945d-3c4851c326f6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:06.769753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a8b6828d-df11-4488-945d-3c4851c326f6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1318 microversion: 2.1 time: 0.308938 Feb 17 03:28:06.770421 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 148/286] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:06 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:07.005895 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b5fa91b0-d72f-49a5-8bd1-0b1505869a44 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:07.007013 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b5fa91b0-d72f-49a5-8bd1-0b1505869a44 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:07.016304 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5fa91b0-d72f-49a5-8bd1-0b1505869a44 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.016810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5fa91b0-d72f-49a5-8bd1-0b1505869a44 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.017636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5fa91b0-d72f-49a5-8bd1-0b1505869a44 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.018113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5fa91b0-d72f-49a5-8bd1-0b1505869a44 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.199609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b5fa91b0-d72f-49a5-8bd1-0b1505869a44 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 24848 microversion: 2.1 time: 0.197383 Feb 17 03:28:07.200340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 139/287] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:07 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 24848 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:07.402382 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-af28e91e-a880-404c-a846-2480e0f0b65d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:07.403049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-af28e91e-a880-404c-a846-2480e0f0b65d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:07.411980 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-af28e91e-a880-404c-a846-2480e0f0b65d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.412483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-af28e91e-a880-404c-a846-2480e0f0b65d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.413314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-af28e91e-a880-404c-a846-2480e0f0b65d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.413800 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-af28e91e-a880-404c-a846-2480e0f0b65d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.582749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bc896431-7050-41cc-b166-8d9fd495f9de tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:07.583907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bc896431-7050-41cc-b166-8d9fd495f9de tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:07.593438 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc896431-7050-41cc-b166-8d9fd495f9de tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.593939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc896431-7050-41cc-b166-8d9fd495f9de tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.594770 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc896431-7050-41cc-b166-8d9fd495f9de tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.595500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc896431-7050-41cc-b166-8d9fd495f9de tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.625306 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-af28e91e-a880-404c-a846-2480e0f0b65d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:07.634916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-af28e91e-a880-404c-a846-2480e0f0b65d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.236428 Feb 17 03:28:07.636181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 149/288] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:07 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:07.733659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fdd0884b-9e42-424c-85c6-67cf09af7321 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:07.734325 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fdd0884b-9e42-424c-85c6-67cf09af7321 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:07.742328 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fdd0884b-9e42-424c-85c6-67cf09af7321 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.742834 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fdd0884b-9e42-424c-85c6-67cf09af7321 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.743705 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fdd0884b-9e42-424c-85c6-67cf09af7321 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.744197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fdd0884b-9e42-424c-85c6-67cf09af7321 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.872908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fdd0884b-9e42-424c-85c6-67cf09af7321 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:07.881860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fdd0884b-9e42-424c-85c6-67cf09af7321 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1265 microversion: 2.1 time: 0.152631 Feb 17 03:28:07.882448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 150/289] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:07 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:07.886954 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-dcff932b-a50c-4b73-8bae-9ee8962279e0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:07.887655 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-dcff932b-a50c-4b73-8bae-9ee8962279e0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:07.895414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dcff932b-a50c-4b73-8bae-9ee8962279e0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.895957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dcff932b-a50c-4b73-8bae-9ee8962279e0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.896777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dcff932b-a50c-4b73-8bae-9ee8962279e0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.897260 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dcff932b-a50c-4b73-8bae-9ee8962279e0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:08.113581 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-dcff932b-a50c-4b73-8bae-9ee8962279e0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:08.122248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-dcff932b-a50c-4b73-8bae-9ee8962279e0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1318 microversion: 2.1 time: 0.238735 Feb 17 03:28:08.122785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 151/290] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:07 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:08.211858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7146cbb0-14ed-49dd-8c81-50fd565191c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:08.213024 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7146cbb0-14ed-49dd-8c81-50fd565191c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:08.222789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7146cbb0-14ed-49dd-8c81-50fd565191c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:08.223296 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7146cbb0-14ed-49dd-8c81-50fd565191c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:08.224217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7146cbb0-14ed-49dd-8c81-50fd565191c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:08.224733 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7146cbb0-14ed-49dd-8c81-50fd565191c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:10.535191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7146cbb0-14ed-49dd-8c81-50fd565191c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 26852 microversion: 2.1 time: 2.326981 Feb 17 03:28:10.535948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 152/291] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:08 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 26852 bytes in 2329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:28:10.541256 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2f19ddb0-dc49-4bca-ac1f-b7224d7e694d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:10.542016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2f19ddb0-dc49-4bca-ac1f-b7224d7e694d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:10.550863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2f19ddb0-dc49-4bca-ac1f-b7224d7e694d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:10.551368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2f19ddb0-dc49-4bca-ac1f-b7224d7e694d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:10.552223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2f19ddb0-dc49-4bca-ac1f-b7224d7e694d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:10.552711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2f19ddb0-dc49-4bca-ac1f-b7224d7e694d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:10.572796 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bc896431-7050-41cc-b166-8d9fd495f9de tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 27868 microversion: 2.20 time: 2.994270 Feb 17 03:28:10.573741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 140/292] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:07 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 27868 bytes in 2997 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:10.578865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-64bea1fb-dda0-4e5c-b988-c3851fa1cd96 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:10.579645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-64bea1fb-dda0-4e5c-b988-c3851fa1cd96 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:10.589049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-64bea1fb-dda0-4e5c-b988-c3851fa1cd96 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:10.589552 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-64bea1fb-dda0-4e5c-b988-c3851fa1cd96 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:10.590379 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-64bea1fb-dda0-4e5c-b988-c3851fa1cd96 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:10.591034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-64bea1fb-dda0-4e5c-b988-c3851fa1cd96 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:10.737438 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-64bea1fb-dda0-4e5c-b988-c3851fa1cd96 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:10.746906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-64bea1fb-dda0-4e5c-b988-c3851fa1cd96 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1265 microversion: 2.1 time: 0.172102 Feb 17 03:28:10.747501 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 141/293] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:10 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:10.752715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6f6fe81e-4ac4-47ed-9f9c-090e5565c01d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:10.753373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6f6fe81e-4ac4-47ed-9f9c-090e5565c01d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:10.761094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6f6fe81e-4ac4-47ed-9f9c-090e5565c01d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:10.761595 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6f6fe81e-4ac4-47ed-9f9c-090e5565c01d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:10.762418 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6f6fe81e-4ac4-47ed-9f9c-090e5565c01d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:10.762909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6f6fe81e-4ac4-47ed-9f9c-090e5565c01d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:10.822248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2f19ddb0-dc49-4bca-ac1f-b7224d7e694d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:10.831829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2f19ddb0-dc49-4bca-ac1f-b7224d7e694d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.294622 Feb 17 03:28:10.832428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 153/294] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:10 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:10.974068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6f6fe81e-4ac4-47ed-9f9c-090e5565c01d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:10.983006 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6f6fe81e-4ac4-47ed-9f9c-090e5565c01d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1318 microversion: 2.1 time: 0.234462 Feb 17 03:28:10.984195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 142/295] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:10 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:11.217096 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-e2480ba7-8072-4910-aef4-ca4126dba6da req-7e68b1e8-df20-4160-b280-36253214c5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed401356-e52d-44a1-aa8a-96252fd9cc98", "name": "network-vif-plugged", "status": "completed", "tag": "5e72f71c-333a-4cfd-859b-95ac38dfea5f"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:11.228009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:11.228009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:28:11.247647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-e2480ba7-8072-4910-aef4-ca4126dba6da req-7e68b1e8-df20-4160-b280-36253214c5f2 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.248144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-e2480ba7-8072-4910-aef4-ca4126dba6da req-7e68b1e8-df20-4160-b280-36253214c5f2 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.270991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-e2480ba7-8072-4910-aef4-ca4126dba6da req-7e68b1e8-df20-4160-b280-36253214c5f2 service nova] Creating event network-vif-plugged:5e72f71c-333a-4cfd-859b-95ac38dfea5f for instance ed401356-e52d-44a1-aa8a-96252fd9cc98 on hv-cinder-75996 Feb 17 03:28:11.281937 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-e2480ba7-8072-4910-aef4-ca4126dba6da req-7e68b1e8-df20-4160-b280-36253214c5f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069194 Feb 17 03:28:11.282604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 154/296] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:11.548413 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9f6fbed2-e475-4c11-b06b-905f02d81578 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:11.549446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9f6fbed2-e475-4c11-b06b-905f02d81578 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:11.557149 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f6fbed2-e475-4c11-b06b-905f02d81578 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.557650 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f6fbed2-e475-4c11-b06b-905f02d81578 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.558470 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f6fbed2-e475-4c11-b06b-905f02d81578 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.558955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f6fbed2-e475-4c11-b06b-905f02d81578 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.586406 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c6a1cfe2-bed8-4694-b7d9-eba5819b7590 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:11.587538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c6a1cfe2-bed8-4694-b7d9-eba5819b7590 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:11.614471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6a1cfe2-bed8-4694-b7d9-eba5819b7590 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.614992 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6a1cfe2-bed8-4694-b7d9-eba5819b7590 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.615891 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6a1cfe2-bed8-4694-b7d9-eba5819b7590 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.616388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6a1cfe2-bed8-4694-b7d9-eba5819b7590 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.757825 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9f6fbed2-e475-4c11-b06b-905f02d81578 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 27228 microversion: 2.1 time: 0.213791 Feb 17 03:28:11.759837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 143/297] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:11 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 27228 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:11.766361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0f4c324e-516d-497d-90b9-e9a944bcaaab tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:11.767138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0f4c324e-516d-497d-90b9-e9a944bcaaab tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:11.775903 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0f4c324e-516d-497d-90b9-e9a944bcaaab tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.776479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0f4c324e-516d-497d-90b9-e9a944bcaaab tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.777306 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0f4c324e-516d-497d-90b9-e9a944bcaaab tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.777792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0f4c324e-516d-497d-90b9-e9a944bcaaab tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.913038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0f4c324e-516d-497d-90b9-e9a944bcaaab tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:11.923729 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0f4c324e-516d-497d-90b9-e9a944bcaaab tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1271 microversion: 2.1 time: 0.162359 Feb 17 03:28:11.934568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 144/298] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:11 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:11.934568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-998dd779-0991-4aab-bc04-a4df8c115b80 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:11.934568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-998dd779-0991-4aab-bc04-a4df8c115b80 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:11.938237 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-998dd779-0991-4aab-bc04-a4df8c115b80 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.938816 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-998dd779-0991-4aab-bc04-a4df8c115b80 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.939761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-998dd779-0991-4aab-bc04-a4df8c115b80 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.940321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-998dd779-0991-4aab-bc04-a4df8c115b80 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.150029 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-998dd779-0991-4aab-bc04-a4df8c115b80 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:12.159550 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-998dd779-0991-4aab-bc04-a4df8c115b80 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.233725 Feb 17 03:28:12.160152 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 145/299] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:11 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:12.164870 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fe243c5e-757e-4454-b736-e3e716878506 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:12.165524 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fe243c5e-757e-4454-b736-e3e716878506 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:12.172963 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe243c5e-757e-4454-b736-e3e716878506 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:12.173463 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe243c5e-757e-4454-b736-e3e716878506 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.174285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe243c5e-757e-4454-b736-e3e716878506 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:12.174768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe243c5e-757e-4454-b736-e3e716878506 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.219460 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c6a1cfe2-bed8-4694-b7d9-eba5819b7590 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28157 microversion: 2.20 time: 0.636577 Feb 17 03:28:12.220096 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 155/300] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:11 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28157 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:12.399073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fe243c5e-757e-4454-b736-e3e716878506 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:12.409037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fe243c5e-757e-4454-b736-e3e716878506 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1318 microversion: 2.1 time: 0.247769 Feb 17 03:28:12.409824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 146/301] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:12 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:12.772057 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8fbd2d59-bc4b-4bd8-80af-dc8d05e2e675 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:12.773189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8fbd2d59-bc4b-4bd8-80af-dc8d05e2e675 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:12.782015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fbd2d59-bc4b-4bd8-80af-dc8d05e2e675 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:12.782519 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fbd2d59-bc4b-4bd8-80af-dc8d05e2e675 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.783342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fbd2d59-bc4b-4bd8-80af-dc8d05e2e675 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:12.783857 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fbd2d59-bc4b-4bd8-80af-dc8d05e2e675 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.943224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5a753c66-b070-471d-ba85-497a3f764ad8 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:12.943996 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5a753c66-b070-471d-ba85-497a3f764ad8 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:12.953022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5a753c66-b070-471d-ba85-497a3f764ad8 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:12.953588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5a753c66-b070-471d-ba85-497a3f764ad8 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.954441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5a753c66-b070-471d-ba85-497a3f764ad8 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:12.954925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5a753c66-b070-471d-ba85-497a3f764ad8 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.981179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8fbd2d59-bc4b-4bd8-80af-dc8d05e2e675 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 27533 microversion: 2.1 time: 0.213280 Feb 17 03:28:12.987039 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 156/302] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:12 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 27533 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:13.177197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5a753c66-b070-471d-ba85-497a3f764ad8 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:13.179612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7258e172-58ed-424a-a117-32fcf42d138f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:13.180474 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7258e172-58ed-424a-a117-32fcf42d138f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:13.187829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5a753c66-b070-471d-ba85-497a3f764ad8 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1313 microversion: 2.1 time: 0.248742 Feb 17 03:28:13.195541 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 147/303] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:12 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:13.195681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7258e172-58ed-424a-a117-32fcf42d138f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:13.195681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7258e172-58ed-424a-a117-32fcf42d138f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:13.195681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7258e172-58ed-424a-a117-32fcf42d138f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:13.195681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7258e172-58ed-424a-a117-32fcf42d138f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:13.232395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-20cf7a96-729b-43bf-a5bc-21539b3f2f0c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:13.235022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-20cf7a96-729b-43bf-a5bc-21539b3f2f0c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:13.250135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-20cf7a96-729b-43bf-a5bc-21539b3f2f0c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:13.250633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-20cf7a96-729b-43bf-a5bc-21539b3f2f0c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:13.251483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-20cf7a96-729b-43bf-a5bc-21539b3f2f0c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:13.251995 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-20cf7a96-729b-43bf-a5bc-21539b3f2f0c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:13.430055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-20cf7a96-729b-43bf-a5bc-21539b3f2f0c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28157 microversion: 2.20 time: 0.202232 Feb 17 03:28:13.432437 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 148/304] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:13 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28157 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:28:13.438953 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9eb2243d-46cb-4d01-81c6-1c92da4f8695 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:13.440150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9eb2243d-46cb-4d01-81c6-1c92da4f8695 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:13.451419 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9eb2243d-46cb-4d01-81c6-1c92da4f8695 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:13.452001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9eb2243d-46cb-4d01-81c6-1c92da4f8695 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:13.453573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9eb2243d-46cb-4d01-81c6-1c92da4f8695 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:13.454108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9eb2243d-46cb-4d01-81c6-1c92da4f8695 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:13.638259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7258e172-58ed-424a-a117-32fcf42d138f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:13.647998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7258e172-58ed-424a-a117-32fcf42d138f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.473277 Feb 17 03:28:13.648606 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 157/305] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:13 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:13.713692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9eb2243d-46cb-4d01-81c6-1c92da4f8695 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:13.723046 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9eb2243d-46cb-4d01-81c6-1c92da4f8695 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1318 microversion: 2.1 time: 0.289201 Feb 17 03:28:13.723679 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 149/306] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:13 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:13.994645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ffdd9094-ff07-4675-90b2-17b565af0474 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:13.995844 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ffdd9094-ff07-4675-90b2-17b565af0474 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:14.006207 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ffdd9094-ff07-4675-90b2-17b565af0474 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.007530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ffdd9094-ff07-4675-90b2-17b565af0474 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.009581 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ffdd9094-ff07-4675-90b2-17b565af0474 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.010280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ffdd9094-ff07-4675-90b2-17b565af0474 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.035226 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-74d2b6f1-6291-433f-b724-457bfe1ee7db req-305876b1-e7c7-47d1-b73d-14fc79ebb549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e182fd58-23ef-4d1f-9792-d7c21018fda0", "tag": "82d1ec47-2523-4972-a419-d4cd51055be6"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:14.036897 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:14.036897 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:28:14.052812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-74d2b6f1-6291-433f-b724-457bfe1ee7db req-305876b1-e7c7-47d1-b73d-14fc79ebb549 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.054048 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-74d2b6f1-6291-433f-b724-457bfe1ee7db req-305876b1-e7c7-47d1-b73d-14fc79ebb549 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.074093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-74d2b6f1-6291-433f-b724-457bfe1ee7db req-305876b1-e7c7-47d1-b73d-14fc79ebb549 service nova] Creating event network-changed:82d1ec47-2523-4972-a419-d4cd51055be6 for instance e182fd58-23ef-4d1f-9792-d7c21018fda0 on hv-cinder-75996 Feb 17 03:28:14.079927 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-74d2b6f1-6291-433f-b724-457bfe1ee7db req-305876b1-e7c7-47d1-b73d-14fc79ebb549 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049253 Feb 17 03:28:14.080714 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 150/307] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:28:14.206435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6af405d6-4fef-4988-8b11-0c472288a1c4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:14.207134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6af405d6-4fef-4988-8b11-0c472288a1c4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:14.215691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6af405d6-4fef-4988-8b11-0c472288a1c4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.216168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6af405d6-4fef-4988-8b11-0c472288a1c4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.217038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6af405d6-4fef-4988-8b11-0c472288a1c4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.217683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6af405d6-4fef-4988-8b11-0c472288a1c4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.373788 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ffdd9094-ff07-4675-90b2-17b565af0474 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 27650 microversion: 2.1 time: 0.382893 Feb 17 03:28:14.374512 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 158/308] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:13 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 27650 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:14.445082 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1956d5d9-cfa1-4d40-a961-a6214529453d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:14.446199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1956d5d9-cfa1-4d40-a961-a6214529453d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:14.456441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1956d5d9-cfa1-4d40-a961-a6214529453d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.457167 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1956d5d9-cfa1-4d40-a961-a6214529453d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.458415 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1956d5d9-cfa1-4d40-a961-a6214529453d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.459171 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1956d5d9-cfa1-4d40-a961-a6214529453d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.472343 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6af405d6-4fef-4988-8b11-0c472288a1c4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:14.482973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6af405d6-4fef-4988-8b11-0c472288a1c4 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1313 microversion: 2.1 time: 0.280868 Feb 17 03:28:14.484553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 151/309] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:14 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:14.667846 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a1c5b089-a291-47fc-a97a-a24372d737ea tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:14.668664 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a1c5b089-a291-47fc-a97a-a24372d737ea tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:14.676429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a1c5b089-a291-47fc-a97a-a24372d737ea tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.676931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a1c5b089-a291-47fc-a97a-a24372d737ea tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.678000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a1c5b089-a291-47fc-a97a-a24372d737ea tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.678530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a1c5b089-a291-47fc-a97a-a24372d737ea tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.684734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1956d5d9-cfa1-4d40-a961-a6214529453d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28157 microversion: 2.20 time: 0.243954 Feb 17 03:28:14.685428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 159/310] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:14 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28157 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:28:14.742623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4ba569b0-0e29-4ebf-83ef-58673b59ccd3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:14.743628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4ba569b0-0e29-4ebf-83ef-58673b59ccd3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:14.752943 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ba569b0-0e29-4ebf-83ef-58673b59ccd3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.753557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ba569b0-0e29-4ebf-83ef-58673b59ccd3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.754711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ba569b0-0e29-4ebf-83ef-58673b59ccd3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.755268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ba569b0-0e29-4ebf-83ef-58673b59ccd3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.971137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a1c5b089-a291-47fc-a97a-a24372d737ea tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:14.980925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a1c5b089-a291-47fc-a97a-a24372d737ea tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.317359 Feb 17 03:28:14.981734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 152/311] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:14 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:15.028180 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4ba569b0-0e29-4ebf-83ef-58673b59ccd3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:15.037812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4ba569b0-0e29-4ebf-83ef-58673b59ccd3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1508 microversion: 2.1 time: 0.300500 Feb 17 03:28:15.038405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 160/312] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:14 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1508 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:15.391028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bd65121a-c175-451e-acff-6320f5d3c81e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:15.392215 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bd65121a-c175-451e-acff-6320f5d3c81e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:15.400219 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bd65121a-c175-451e-acff-6320f5d3c81e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:15.400719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bd65121a-c175-451e-acff-6320f5d3c81e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:15.401545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bd65121a-c175-451e-acff-6320f5d3c81e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:15.402150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bd65121a-c175-451e-acff-6320f5d3c81e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:15.502336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f42c63b3-cd00-4a7b-b483-770af1b7d786 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:15.503007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f42c63b3-cd00-4a7b-b483-770af1b7d786 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:15.513089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f42c63b3-cd00-4a7b-b483-770af1b7d786 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:15.513753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f42c63b3-cd00-4a7b-b483-770af1b7d786 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:15.514646 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f42c63b3-cd00-4a7b-b483-770af1b7d786 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:15.515815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f42c63b3-cd00-4a7b-b483-770af1b7d786 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:15.697228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bd65121a-c175-451e-acff-6320f5d3c81e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 27749 microversion: 2.1 time: 0.310485 Feb 17 03:28:15.701457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 153/313] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:15 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 27749 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:15.704020 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-14d9032b-7f43-4020-ab4d-85ac291be81a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:15.705137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-14d9032b-7f43-4020-ab4d-85ac291be81a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:15.713974 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14d9032b-7f43-4020-ab4d-85ac291be81a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:15.714472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14d9032b-7f43-4020-ab4d-85ac291be81a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:15.715304 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14d9032b-7f43-4020-ab4d-85ac291be81a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:15.715807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14d9032b-7f43-4020-ab4d-85ac291be81a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:15.749015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f42c63b3-cd00-4a7b-b483-770af1b7d786 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:15.758630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f42c63b3-cd00-4a7b-b483-770af1b7d786 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1313 microversion: 2.1 time: 0.261237 Feb 17 03:28:15.759364 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 161/314] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:15 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:15.999488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6c66df57-77a1-4e0d-b0bf-fa770fa0ed93 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:16.000179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6c66df57-77a1-4e0d-b0bf-fa770fa0ed93 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:16.008161 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c66df57-77a1-4e0d-b0bf-fa770fa0ed93 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:16.008714 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c66df57-77a1-4e0d-b0bf-fa770fa0ed93 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:16.009492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c66df57-77a1-4e0d-b0bf-fa770fa0ed93 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:16.009980 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c66df57-77a1-4e0d-b0bf-fa770fa0ed93 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:16.099817 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-14d9032b-7f43-4020-ab4d-85ac291be81a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28157 microversion: 2.20 time: 0.400334 Feb 17 03:28:16.100521 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 154/315] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:15 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28157 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:16.257899 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6c66df57-77a1-4e0d-b0bf-fa770fa0ed93 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:16.270053 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6c66df57-77a1-4e0d-b0bf-fa770fa0ed93 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1521 microversion: 2.1 time: 0.274367 Feb 17 03:28:16.271213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 162/316] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:15 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:16.641193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4e701927-4a03-4ce7-9b65-6631f39a3420 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3801e977-2f42-4590-b563-5b924baff552"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:16.642472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4e701927-4a03-4ce7-9b65-6631f39a3420 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:16.651016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e701927-4a03-4ce7-9b65-6631f39a3420 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:16.651554 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e701927-4a03-4ce7-9b65-6631f39a3420 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:16.652375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e701927-4a03-4ce7-9b65-6631f39a3420 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:16.652861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e701927-4a03-4ce7-9b65-6631f39a3420 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:16.710216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d7e555aa-6579-4bd8-a3d1-1694c0d21433 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:16.711372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d7e555aa-6579-4bd8-a3d1-1694c0d21433 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:16.719876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7e555aa-6579-4bd8-a3d1-1694c0d21433 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:16.720370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7e555aa-6579-4bd8-a3d1-1694c0d21433 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:16.721984 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7e555aa-6579-4bd8-a3d1-1694c0d21433 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:16.722473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7e555aa-6579-4bd8-a3d1-1694c0d21433 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:16.951491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d7e555aa-6579-4bd8-a3d1-1694c0d21433 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 27996 microversion: 2.1 time: 0.245077 Feb 17 03:28:16.953134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 163/317] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:16 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 27996 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:28:16.958423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-55aef9b3-097a-4856-8e73-3cdd325d9548 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:16.959274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-55aef9b3-097a-4856-8e73-3cdd325d9548 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:16.967785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-55aef9b3-097a-4856-8e73-3cdd325d9548 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:16.968380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-55aef9b3-097a-4856-8e73-3cdd325d9548 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:16.969218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-55aef9b3-097a-4856-8e73-3cdd325d9548 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:16.969707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-55aef9b3-097a-4856-8e73-3cdd325d9548 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.147631 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4e701927-4a03-4ce7-9b65-6631f39a3420 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "POST /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.510884 Feb 17 03:28:17.153732 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 155/318] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:28:16 2021] POST /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:17.170693 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-68cd5cb4-e1b9-4acf-a8e4-fbbbea3fa4d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:17.172931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-68cd5cb4-e1b9-4acf-a8e4-fbbbea3fa4d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:17.184527 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-68cd5cb4-e1b9-4acf-a8e4-fbbbea3fa4d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.185188 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-68cd5cb4-e1b9-4acf-a8e4-fbbbea3fa4d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.186483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-68cd5cb4-e1b9-4acf-a8e4-fbbbea3fa4d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.187298 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-68cd5cb4-e1b9-4acf-a8e4-fbbbea3fa4d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.195016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-55aef9b3-097a-4856-8e73-3cdd325d9548 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:17.206839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-55aef9b3-097a-4856-8e73-3cdd325d9548 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1313 microversion: 2.1 time: 0.252572 Feb 17 03:28:17.208225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 164/319] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:16 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:17.290933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-08a63687-27a8-4f49-a7ca-e59191ac12ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:17.291883 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-08a63687-27a8-4f49-a7ca-e59191ac12ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:17.302785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-08a63687-27a8-4f49-a7ca-e59191ac12ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.303919 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-08a63687-27a8-4f49-a7ca-e59191ac12ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.304789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-08a63687-27a8-4f49-a7ca-e59191ac12ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.305561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-08a63687-27a8-4f49-a7ca-e59191ac12ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.414991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-68cd5cb4-e1b9-4acf-a8e4-fbbbea3fa4d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28447 microversion: 2.20 time: 0.264996 Feb 17 03:28:17.416431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 156/320] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:17 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28447 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:17.537642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-08a63687-27a8-4f49-a7ca-e59191ac12ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:17.549239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-08a63687-27a8-4f49-a7ca-e59191ac12ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1501 microversion: 2.1 time: 0.263046 Feb 17 03:28:17.549929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 165/321] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:17 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1501 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:17.567382 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-df385966-2568-4e45-b9ac-85fa855bff56 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:17.568380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-df385966-2568-4e45-b9ac-85fa855bff56 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:17.590381 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df385966-2568-4e45-b9ac-85fa855bff56 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.591092 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df385966-2568-4e45-b9ac-85fa855bff56 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.591957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df385966-2568-4e45-b9ac-85fa855bff56 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.592524 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df385966-2568-4e45-b9ac-85fa855bff56 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.810732 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-df385966-2568-4e45-b9ac-85fa855bff56 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:17.820119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-df385966-2568-4e45-b9ac-85fa855bff56 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1514 microversion: 2.1 time: 0.257534 Feb 17 03:28:17.820628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 157/322] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:17 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:17.964808 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c7953329-4d77-46ec-aee3-abbf6196282f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:17.965644 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c7953329-4d77-46ec-aee3-abbf6196282f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:17.977707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c7953329-4d77-46ec-aee3-abbf6196282f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.978213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c7953329-4d77-46ec-aee3-abbf6196282f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.979162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c7953329-4d77-46ec-aee3-abbf6196282f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.979535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c7953329-4d77-46ec-aee3-abbf6196282f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:18.226095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6da17e11-ebd4-43d6-a293-775b7ab74e64 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:18.227458 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6da17e11-ebd4-43d6-a293-775b7ab74e64 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:18.244279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c7953329-4d77-46ec-aee3-abbf6196282f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28129 microversion: 2.1 time: 0.283430 Feb 17 03:28:18.245088 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 166/323] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:17 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28129 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:18.246569 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6da17e11-ebd4-43d6-a293-775b7ab74e64 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:18.248415 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6da17e11-ebd4-43d6-a293-775b7ab74e64 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:18.252843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6da17e11-ebd4-43d6-a293-775b7ab74e64 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:18.253342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6da17e11-ebd4-43d6-a293-775b7ab74e64 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:18.338489 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-499c0fc2-84bd-4145-867f-7c360d81dec2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a56050d4-cd25-491d-b5c8-e0039fe7a73b", "device": "/dev/sdb"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:18.340468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-499c0fc2-84bd-4145-867f-7c360d81dec2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:18.349742 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-499c0fc2-84bd-4145-867f-7c360d81dec2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:18.350524 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-499c0fc2-84bd-4145-867f-7c360d81dec2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:18.351625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-499c0fc2-84bd-4145-867f-7c360d81dec2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:18.352306 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-499c0fc2-84bd-4145-867f-7c360d81dec2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:18.523359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6da17e11-ebd4-43d6-a293-775b7ab74e64 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:18.535501 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6da17e11-ebd4-43d6-a293-775b7ab74e64 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1313 microversion: 2.1 time: 0.313860 Feb 17 03:28:18.537686 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 158/324] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:18 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:18.543112 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bc38f935-7cda-4025-907e-963d20e90351 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:18.544693 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bc38f935-7cda-4025-907e-963d20e90351 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:18.554586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc38f935-7cda-4025-907e-963d20e90351 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:18.563775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc38f935-7cda-4025-907e-963d20e90351 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:18.564704 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc38f935-7cda-4025-907e-963d20e90351 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:18.565207 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc38f935-7cda-4025-907e-963d20e90351 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:18.820582 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bc38f935-7cda-4025-907e-963d20e90351 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28447 microversion: 2.20 time: 0.281300 Feb 17 03:28:18.821269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 159/325] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:18 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28447 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:18.915130 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-499c0fc2-84bd-4145-867f-7c360d81dec2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "POST /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.580960 Feb 17 03:28:18.916119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 167/326] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:28:18 2021] POST /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445/os-volume_attachments => generated 194 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:19.257743 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0a94a2cc-0ba1-461c-b770-f930281c1097 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:19.258935 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0a94a2cc-0ba1-461c-b770-f930281c1097 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:19.267598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a94a2cc-0ba1-461c-b770-f930281c1097 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.268105 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a94a2cc-0ba1-461c-b770-f930281c1097 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.268936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a94a2cc-0ba1-461c-b770-f930281c1097 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.269427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a94a2cc-0ba1-461c-b770-f930281c1097 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.418256 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0a94a2cc-0ba1-461c-b770-f930281c1097 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28129 microversion: 2.1 time: 0.164719 Feb 17 03:28:19.418866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 160/327] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:19 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28129 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:19.535287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-71655a64-2a0a-4be3-a7f9-2ffc2cef9d37 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:19.536571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-71655a64-2a0a-4be3-a7f9-2ffc2cef9d37 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:19.545274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71655a64-2a0a-4be3-a7f9-2ffc2cef9d37 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.545791 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71655a64-2a0a-4be3-a7f9-2ffc2cef9d37 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.546635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71655a64-2a0a-4be3-a7f9-2ffc2cef9d37 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.547178 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71655a64-2a0a-4be3-a7f9-2ffc2cef9d37 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.555462 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-27bd7714-e15d-4e4f-93e3-77cf6607ce4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:19.556284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-27bd7714-e15d-4e4f-93e3-77cf6607ce4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:19.565568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-27bd7714-e15d-4e4f-93e3-77cf6607ce4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.566082 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-27bd7714-e15d-4e4f-93e3-77cf6607ce4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.567124 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-27bd7714-e15d-4e4f-93e3-77cf6607ce4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.567645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-27bd7714-e15d-4e4f-93e3-77cf6607ce4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.613009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-71655a64-2a0a-4be3-a7f9-2ffc2cef9d37 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lazy-loading 'flavor' on Instance uuid 6ec09d11-1456-48e6-9b4a-cbb0c7775f78 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:28:19.763690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-71655a64-2a0a-4be3-a7f9-2ffc2cef9d37 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "POST /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/action" status: 200 len: 32 microversion: 2.1 time: 0.232991 Feb 17 03:28:19.764358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 168/328] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:19 2021] POST /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:28:19.775398 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-323b4418-8594-46ee-ae7e-04795a565305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:19.776204 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-323b4418-8594-46ee-ae7e-04795a565305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:19.786298 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-323b4418-8594-46ee-ae7e-04795a565305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.786803 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-323b4418-8594-46ee-ae7e-04795a565305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.787708 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-323b4418-8594-46ee-ae7e-04795a565305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.788197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-323b4418-8594-46ee-ae7e-04795a565305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.794764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-27bd7714-e15d-4e4f-93e3-77cf6607ce4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:19.804568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-27bd7714-e15d-4e4f-93e3-77cf6607ce4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1313 microversion: 2.1 time: 0.254018 Feb 17 03:28:19.805183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 161/329] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:19 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:19.834567 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-dfc7f93a-a703-4024-8ed7-38a65d1cbd11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:19.835637 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-dfc7f93a-a703-4024-8ed7-38a65d1cbd11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:19.844801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dfc7f93a-a703-4024-8ed7-38a65d1cbd11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.845880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dfc7f93a-a703-4024-8ed7-38a65d1cbd11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.846742 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dfc7f93a-a703-4024-8ed7-38a65d1cbd11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.847234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dfc7f93a-a703-4024-8ed7-38a65d1cbd11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:20.002523 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-323b4418-8594-46ee-ae7e-04795a565305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:20.011286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-323b4418-8594-46ee-ae7e-04795a565305 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.240734 Feb 17 03:28:20.011931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 169/330] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:19 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:20.063064 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-dfc7f93a-a703-4024-8ed7-38a65d1cbd11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28612 microversion: 2.20 time: 0.232192 Feb 17 03:28:20.064923 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 162/331] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:19 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28612 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:28:20.431613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-77818b73-a13c-4408-9292-3b898626ff90 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:20.432565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-77818b73-a13c-4408-9292-3b898626ff90 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:20.440862 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-77818b73-a13c-4408-9292-3b898626ff90 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:20.441354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-77818b73-a13c-4408-9292-3b898626ff90 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:20.442171 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-77818b73-a13c-4408-9292-3b898626ff90 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:20.442648 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-77818b73-a13c-4408-9292-3b898626ff90 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:20.629389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-77818b73-a13c-4408-9292-3b898626ff90 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28129 microversion: 2.1 time: 0.201742 Feb 17 03:28:20.630103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 170/332] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:20 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28129 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:20.823946 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5af9dac6-2b8f-4f45-af2c-b8703c71a507 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:20.824730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5af9dac6-2b8f-4f45-af2c-b8703c71a507 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:20.833339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5af9dac6-2b8f-4f45-af2c-b8703c71a507 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:20.833842 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5af9dac6-2b8f-4f45-af2c-b8703c71a507 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:20.834672 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5af9dac6-2b8f-4f45-af2c-b8703c71a507 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:20.835161 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5af9dac6-2b8f-4f45-af2c-b8703c71a507 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.031747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-78e87bc9-5342-416a-8028-edba7924d25b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:21.032624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-78e87bc9-5342-416a-8028-edba7924d25b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:21.041108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-78e87bc9-5342-416a-8028-edba7924d25b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.041704 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-78e87bc9-5342-416a-8028-edba7924d25b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.042547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-78e87bc9-5342-416a-8028-edba7924d25b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.043021 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-78e87bc9-5342-416a-8028-edba7924d25b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.054129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5af9dac6-2b8f-4f45-af2c-b8703c71a507 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:21.062942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5af9dac6-2b8f-4f45-af2c-b8703c71a507 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1313 microversion: 2.1 time: 0.243576 Feb 17 03:28:21.063562 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 163/333] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:20 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:21.075378 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ac742bf1-6dea-4d9d-85e6-69b06b5871e8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:21.076665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ac742bf1-6dea-4d9d-85e6-69b06b5871e8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:21.085340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ac742bf1-6dea-4d9d-85e6-69b06b5871e8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.085921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ac742bf1-6dea-4d9d-85e6-69b06b5871e8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.086880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ac742bf1-6dea-4d9d-85e6-69b06b5871e8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.087355 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ac742bf1-6dea-4d9d-85e6-69b06b5871e8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.274275 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ac742bf1-6dea-4d9d-85e6-69b06b5871e8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28612 microversion: 2.20 time: 0.202512 Feb 17 03:28:21.275656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 164/334] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:21 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28612 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:28:21.305920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-78e87bc9-5342-416a-8028-edba7924d25b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:21.314924 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-78e87bc9-5342-416a-8028-edba7924d25b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.288312 Feb 17 03:28:21.315539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 171/335] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:21 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:21.393495 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-1b4bc9de-a783-4547-ab9d-bc7ad7165564 req-7b4aa4b2-6c85-4c6f-8f29-3f5eb13f63a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e182fd58-23ef-4d1f-9792-d7c21018fda0", "name": "network-vif-plugged", "status": "completed", "tag": "82d1ec47-2523-4972-a419-d4cd51055be6"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:21.395194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:21.395194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:28:21.406941 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-1b4bc9de-a783-4547-ab9d-bc7ad7165564 req-7b4aa4b2-6c85-4c6f-8f29-3f5eb13f63a1 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.407432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-1b4bc9de-a783-4547-ab9d-bc7ad7165564 req-7b4aa4b2-6c85-4c6f-8f29-3f5eb13f63a1 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.426530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-1b4bc9de-a783-4547-ab9d-bc7ad7165564 req-7b4aa4b2-6c85-4c6f-8f29-3f5eb13f63a1 service nova] Creating event network-vif-plugged:82d1ec47-2523-4972-a419-d4cd51055be6 for instance e182fd58-23ef-4d1f-9792-d7c21018fda0 on hv-cinder-75996 Feb 17 03:28:21.431471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-1b4bc9de-a783-4547-ab9d-bc7ad7165564 req-7b4aa4b2-6c85-4c6f-8f29-3f5eb13f63a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043167 Feb 17 03:28:21.432446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 165/336] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:21.642806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a2af6b0e-54ab-4f99-b964-e0cdebba2105 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:21.644049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a2af6b0e-54ab-4f99-b964-e0cdebba2105 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:21.652924 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2af6b0e-54ab-4f99-b964-e0cdebba2105 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.653353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2af6b0e-54ab-4f99-b964-e0cdebba2105 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.654178 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2af6b0e-54ab-4f99-b964-e0cdebba2105 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.654882 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2af6b0e-54ab-4f99-b964-e0cdebba2105 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.863604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a2af6b0e-54ab-4f99-b964-e0cdebba2105 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28129 microversion: 2.1 time: 0.225251 Feb 17 03:28:21.864311 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 172/337] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:21 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28129 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:22.080663 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-dfc819a0-d69a-481b-8975-2cbacd547b5f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:22.081428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-dfc819a0-d69a-481b-8975-2cbacd547b5f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:22.089532 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dfc819a0-d69a-481b-8975-2cbacd547b5f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:22.090034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dfc819a0-d69a-481b-8975-2cbacd547b5f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:22.090859 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dfc819a0-d69a-481b-8975-2cbacd547b5f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:22.091347 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dfc819a0-d69a-481b-8975-2cbacd547b5f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:22.288233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-46b3da47-8672-42a0-b5f6-b00ac35115ec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:22.289509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-46b3da47-8672-42a0-b5f6-b00ac35115ec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:22.300715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46b3da47-8672-42a0-b5f6-b00ac35115ec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:22.301411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46b3da47-8672-42a0-b5f6-b00ac35115ec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:22.303198 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46b3da47-8672-42a0-b5f6-b00ac35115ec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:22.304166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46b3da47-8672-42a0-b5f6-b00ac35115ec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:22.311317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-dfc819a0-d69a-481b-8975-2cbacd547b5f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:22.322960 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-dfc819a0-d69a-481b-8975-2cbacd547b5f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1313 microversion: 2.1 time: 0.246659 Feb 17 03:28:22.323728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 166/338] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:22 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:22.338723 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-eeec0a62-6c1a-4f5c-a718-dfdf5d6af9e6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:22.339387 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-eeec0a62-6c1a-4f5c-a718-dfdf5d6af9e6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:22.348288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eeec0a62-6c1a-4f5c-a718-dfdf5d6af9e6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:22.348796 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eeec0a62-6c1a-4f5c-a718-dfdf5d6af9e6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:22.349629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eeec0a62-6c1a-4f5c-a718-dfdf5d6af9e6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:22.350116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eeec0a62-6c1a-4f5c-a718-dfdf5d6af9e6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:22.492039 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-46b3da47-8672-42a0-b5f6-b00ac35115ec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28612 microversion: 2.20 time: 0.208076 Feb 17 03:28:22.496897 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 173/339] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:22 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28612 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:22.586547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-eeec0a62-6c1a-4f5c-a718-dfdf5d6af9e6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:22.596760 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-eeec0a62-6c1a-4f5c-a718-dfdf5d6af9e6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.261799 Feb 17 03:28:22.597469 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 167/340] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:22 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:22.877317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6d5a4db1-69e6-4ee4-b7dd-6a49d366d6e7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:22.878533 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6d5a4db1-69e6-4ee4-b7dd-6a49d366d6e7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:22.887070 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6d5a4db1-69e6-4ee4-b7dd-6a49d366d6e7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:22.887685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6d5a4db1-69e6-4ee4-b7dd-6a49d366d6e7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:22.888576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6d5a4db1-69e6-4ee4-b7dd-6a49d366d6e7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:22.889135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6d5a4db1-69e6-4ee4-b7dd-6a49d366d6e7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:23.072192 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6d5a4db1-69e6-4ee4-b7dd-6a49d366d6e7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28129 microversion: 2.1 time: 0.199617 Feb 17 03:28:23.073050 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 174/341] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:22 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28129 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:28:23.341431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4db37520-1f80-4b57-a55b-108b70741e1c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:23.342054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4db37520-1f80-4b57-a55b-108b70741e1c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:23.350203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4db37520-1f80-4b57-a55b-108b70741e1c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:23.350696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4db37520-1f80-4b57-a55b-108b70741e1c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:23.351504 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4db37520-1f80-4b57-a55b-108b70741e1c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:23.352009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4db37520-1f80-4b57-a55b-108b70741e1c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:23.505860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-457dee73-3649-4ea7-879e-a1ca7bfd543b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:23.507749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-457dee73-3649-4ea7-879e-a1ca7bfd543b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:23.516933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-457dee73-3649-4ea7-879e-a1ca7bfd543b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:23.517435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-457dee73-3649-4ea7-879e-a1ca7bfd543b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:23.518266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-457dee73-3649-4ea7-879e-a1ca7bfd543b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:23.518749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-457dee73-3649-4ea7-879e-a1ca7bfd543b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:23.570734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4db37520-1f80-4b57-a55b-108b70741e1c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:23.579536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4db37520-1f80-4b57-a55b-108b70741e1c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1313 microversion: 2.1 time: 0.242210 Feb 17 03:28:23.580107 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 168/342] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:23 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:23.614634 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-177a8d99-a676-4454-abfd-e4c7784ff781 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:23.615297 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-177a8d99-a676-4454-abfd-e4c7784ff781 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:23.623182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-177a8d99-a676-4454-abfd-e4c7784ff781 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:23.623762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-177a8d99-a676-4454-abfd-e4c7784ff781 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:23.625223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-177a8d99-a676-4454-abfd-e4c7784ff781 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:23.625720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-177a8d99-a676-4454-abfd-e4c7784ff781 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:23.837500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-457dee73-3649-4ea7-879e-a1ca7bfd543b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28612 microversion: 2.20 time: 0.335827 Feb 17 03:28:23.838457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 175/343] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:23 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28612 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:28:23.839029 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-177a8d99-a676-4454-abfd-e4c7784ff781 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:23.848955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-177a8d99-a676-4454-abfd-e4c7784ff781 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.238162 Feb 17 03:28:23.849545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 169/344] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:23 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:24.086629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0d01681d-b9fd-44d1-9835-daa153b34371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:24.087989 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0d01681d-b9fd-44d1-9835-daa153b34371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:24.097464 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d01681d-b9fd-44d1-9835-daa153b34371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:24.097976 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d01681d-b9fd-44d1-9835-daa153b34371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:24.098821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d01681d-b9fd-44d1-9835-daa153b34371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:24.099314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d01681d-b9fd-44d1-9835-daa153b34371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:24.365353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0d01681d-b9fd-44d1-9835-daa153b34371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28338 microversion: 2.1 time: 0.283454 Feb 17 03:28:24.369474 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 176/345] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:24 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28338 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:24.597560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-04923f58-082a-43ad-8ba4-16d5fdfd9af2 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:24.598213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-04923f58-082a-43ad-8ba4-16d5fdfd9af2 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:24.606390 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-04923f58-082a-43ad-8ba4-16d5fdfd9af2 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:24.606879 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-04923f58-082a-43ad-8ba4-16d5fdfd9af2 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:24.607722 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-04923f58-082a-43ad-8ba4-16d5fdfd9af2 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:24.608200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-04923f58-082a-43ad-8ba4-16d5fdfd9af2 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:24.851221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7c18a692-503e-47fb-881c-00e5336133c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:24.852412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7c18a692-503e-47fb-881c-00e5336133c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:24.861613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7c18a692-503e-47fb-881c-00e5336133c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:24.862095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7c18a692-503e-47fb-881c-00e5336133c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:24.862955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7c18a692-503e-47fb-881c-00e5336133c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:24.863442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7c18a692-503e-47fb-881c-00e5336133c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:25.023282 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-04923f58-082a-43ad-8ba4-16d5fdfd9af2 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:25.032228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-04923f58-082a-43ad-8ba4-16d5fdfd9af2 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1497 microversion: 2.1 time: 0.438829 Feb 17 03:28:25.032771 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 170/346] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:24 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1497 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:25.037780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f0b013e5-15cf-4a05-afee-018faea68f26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:25.038864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f0b013e5-15cf-4a05-afee-018faea68f26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:25.041007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7c18a692-503e-47fb-881c-00e5336133c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28612 microversion: 2.20 time: 0.194605 Feb 17 03:28:25.042723 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 177/347] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:24 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28612 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:25.047103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f0b013e5-15cf-4a05-afee-018faea68f26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:25.047623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f0b013e5-15cf-4a05-afee-018faea68f26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:25.048463 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f0b013e5-15cf-4a05-afee-018faea68f26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:25.049029 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f0b013e5-15cf-4a05-afee-018faea68f26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:25.275783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f0b013e5-15cf-4a05-afee-018faea68f26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:25.285034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f0b013e5-15cf-4a05-afee-018faea68f26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.251207 Feb 17 03:28:25.285564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 171/348] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:25 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:25.377432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-eff46d91-a95a-4b9c-9f9c-237e01db2cf2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:25.378696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-eff46d91-a95a-4b9c-9f9c-237e01db2cf2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:25.387136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eff46d91-a95a-4b9c-9f9c-237e01db2cf2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:25.387668 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eff46d91-a95a-4b9c-9f9c-237e01db2cf2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:25.388489 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eff46d91-a95a-4b9c-9f9c-237e01db2cf2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:25.388972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eff46d91-a95a-4b9c-9f9c-237e01db2cf2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:25.614941 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-eff46d91-a95a-4b9c-9f9c-237e01db2cf2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28417 microversion: 2.1 time: 0.241744 Feb 17 03:28:25.619404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 178/349] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:25 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28417 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:26.054933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-755b43db-c609-4ee3-855a-9efdb068e143 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:26.055992 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-755b43db-c609-4ee3-855a-9efdb068e143 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:26.063840 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-755b43db-c609-4ee3-855a-9efdb068e143 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.064339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-755b43db-c609-4ee3-855a-9efdb068e143 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.065229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-755b43db-c609-4ee3-855a-9efdb068e143 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.065701 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-755b43db-c609-4ee3-855a-9efdb068e143 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.245495 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-755b43db-c609-4ee3-855a-9efdb068e143 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28612 microversion: 2.20 time: 0.194789 Feb 17 03:28:26.247111 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 172/350] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:26 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28612 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:26.303110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1233cff4-0441-4acb-9356-4c7798e9408b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:26.303904 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1233cff4-0441-4acb-9356-4c7798e9408b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:26.313713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1233cff4-0441-4acb-9356-4c7798e9408b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.314340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1233cff4-0441-4acb-9356-4c7798e9408b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.315243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-52b38f90-75d9-4b75-a4ea-82df8c7b7403 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3801e977-2f42-4590-b563-5b924baff552"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:26.315416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1233cff4-0441-4acb-9356-4c7798e9408b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.316057 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1233cff4-0441-4acb-9356-4c7798e9408b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.316536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-52b38f90-75d9-4b75-a4ea-82df8c7b7403 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:26.325765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-52b38f90-75d9-4b75-a4ea-82df8c7b7403 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.326333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-52b38f90-75d9-4b75-a4ea-82df8c7b7403 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.327173 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-52b38f90-75d9-4b75-a4ea-82df8c7b7403 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.327825 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-52b38f90-75d9-4b75-a4ea-82df8c7b7403 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.506866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-52b38f90-75d9-4b75-a4ea-82df8c7b7403 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] HTTP exception thrown: Invalid volume: volume 3801e977-2f42-4590-b563-5b924baff552 is already attached to instances: ed401356-e52d-44a1-aa8a-96252fd9cc98 Feb 17 03:28:26.507653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-52b38f90-75d9-4b75-a4ea-82df8c7b7403 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Returning 400 to user: Invalid volume: volume 3801e977-2f42-4590-b563-5b924baff552 is already attached to instances: ed401356-e52d-44a1-aa8a-96252fd9cc98 {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:28:26.508634 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-52b38f90-75d9-4b75-a4ea-82df8c7b7403 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "POST /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.198106 Feb 17 03:28:26.509359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 173/351] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:28:26 2021] POST /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98/os-volume_attachments => generated 174 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:28:26.514181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5dd2edb6-6bd4-401a-95d1-d227d83ad42f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:26.514928 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5dd2edb6-6bd4-401a-95d1-d227d83ad42f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:26.523930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5dd2edb6-6bd4-401a-95d1-d227d83ad42f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.524442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5dd2edb6-6bd4-401a-95d1-d227d83ad42f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.525761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5dd2edb6-6bd4-401a-95d1-d227d83ad42f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.525761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5dd2edb6-6bd4-401a-95d1-d227d83ad42f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.534489 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1233cff4-0441-4acb-9356-4c7798e9408b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:26.544166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1233cff4-0441-4acb-9356-4c7798e9408b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.245606 Feb 17 03:28:26.544979 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 179/352] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:26 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:26.592118 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5dd2edb6-6bd4-401a-95d1-d227d83ad42f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Going to try to terminate instance {{(pid=98183) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:28:26.619785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9681ce91-6ec5-492d-b19b-34bbca3cbac4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:26.620329 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9681ce91-6ec5-492d-b19b-34bbca3cbac4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:26.628894 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9681ce91-6ec5-492d-b19b-34bbca3cbac4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.629399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9681ce91-6ec5-492d-b19b-34bbca3cbac4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.630232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9681ce91-6ec5-492d-b19b-34bbca3cbac4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.630723 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9681ce91-6ec5-492d-b19b-34bbca3cbac4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.709432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5dd2edb6-6bd4-401a-95d1-d227d83ad42f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 204 len: 0 microversion: 2.1 time: 0.198741 Feb 17 03:28:26.710038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 174/353] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:28:26 2021] DELETE /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:28:26.716718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-29dd7c3e-7b8b-4e98-a3e9-add69cb21b36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:26.718016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-29dd7c3e-7b8b-4e98-a3e9-add69cb21b36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:26.726202 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-29dd7c3e-7b8b-4e98-a3e9-add69cb21b36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.726697 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-29dd7c3e-7b8b-4e98-a3e9-add69cb21b36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.727539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-29dd7c3e-7b8b-4e98-a3e9-add69cb21b36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.728023 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-29dd7c3e-7b8b-4e98-a3e9-add69cb21b36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.880970 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-9681ce91-6ec5-492d-b19b-34bbca3cbac4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lazy-loading 'services' on Instance uuid ed401356-e52d-44a1-aa8a-96252fd9cc98 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:28:26.918849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-29dd7c3e-7b8b-4e98-a3e9-add69cb21b36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28479 microversion: 2.1 time: 0.206509 Feb 17 03:28:26.923118 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 175/354] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:26 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28479 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:26.924872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bbbeb79d-16f6-4224-8656-a8f97803e6fb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:26.925614 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bbbeb79d-16f6-4224-8656-a8f97803e6fb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:26.934074 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bbbeb79d-16f6-4224-8656-a8f97803e6fb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.934567 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bbbeb79d-16f6-4224-8656-a8f97803e6fb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.935380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bbbeb79d-16f6-4224-8656-a8f97803e6fb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.935882 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bbbeb79d-16f6-4224-8656-a8f97803e6fb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:27.030679 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9681ce91-6ec5-492d-b19b-34bbca3cbac4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98/os-volume_attachments/3801e977-2f42-4590-b563-5b924baff552" status: 202 len: 0 microversion: 2.1 time: 0.414786 Feb 17 03:28:27.031450 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 180/355] 10.222.0.46 () {58 vars in 1406 bytes} [Wed Feb 17 03:28:26 2021] DELETE /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98/os-volume_attachments/3801e977-2f42-4590-b563-5b924baff552 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:28:27.177267 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bbbeb79d-16f6-4224-8656-a8f97803e6fb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:27.186886 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bbbeb79d-16f6-4224-8656-a8f97803e6fb tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1503 microversion: 2.1 time: 0.266038 Feb 17 03:28:27.188104 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 176/356] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:26 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:27.258415 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-96f40fe9-1e63-4a6b-98be-d8b101c8d4f5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:27.259768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-96f40fe9-1e63-4a6b-98be-d8b101c8d4f5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:27.268150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-96f40fe9-1e63-4a6b-98be-d8b101c8d4f5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:27.268655 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-96f40fe9-1e63-4a6b-98be-d8b101c8d4f5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:27.269492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-96f40fe9-1e63-4a6b-98be-d8b101c8d4f5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:27.269981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-96f40fe9-1e63-4a6b-98be-d8b101c8d4f5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:27.443657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-96f40fe9-1e63-4a6b-98be-d8b101c8d4f5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28612 microversion: 2.20 time: 0.188995 Feb 17 03:28:27.444485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 181/357] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:27 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28612 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:27.562767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-37f20b97-d6c9-4cd0-94f7-3cb04c850afe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:27.563432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-37f20b97-d6c9-4cd0-94f7-3cb04c850afe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:27.571374 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-37f20b97-d6c9-4cd0-94f7-3cb04c850afe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:27.571909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-37f20b97-d6c9-4cd0-94f7-3cb04c850afe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:27.572736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-37f20b97-d6c9-4cd0-94f7-3cb04c850afe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:27.573226 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-37f20b97-d6c9-4cd0-94f7-3cb04c850afe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:27.781829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-37f20b97-d6c9-4cd0-94f7-3cb04c850afe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:27.790908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-37f20b97-d6c9-4cd0-94f7-3cb04c850afe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.232175 Feb 17 03:28:27.791542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 177/358] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:27 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:27.931450 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1997e317-8271-4033-bf82-4188c6895f79 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:27.932608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1997e317-8271-4033-bf82-4188c6895f79 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:27.941077 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1997e317-8271-4033-bf82-4188c6895f79 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:27.941582 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1997e317-8271-4033-bf82-4188c6895f79 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:27.942406 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1997e317-8271-4033-bf82-4188c6895f79 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:27.943163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1997e317-8271-4033-bf82-4188c6895f79 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:28.136304 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1997e317-8271-4033-bf82-4188c6895f79 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28584 microversion: 2.1 time: 0.209052 Feb 17 03:28:28.137080 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 182/359] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:27 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28584 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:28.207103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-baaf6d1c-5939-4b18-bb13-a5dbe09562ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:28.207915 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-baaf6d1c-5939-4b18-bb13-a5dbe09562ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:28.221200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-baaf6d1c-5939-4b18-bb13-a5dbe09562ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:28.221702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-baaf6d1c-5939-4b18-bb13-a5dbe09562ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:28.222538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-baaf6d1c-5939-4b18-bb13-a5dbe09562ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:28.223168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-baaf6d1c-5939-4b18-bb13-a5dbe09562ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:28.438114 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-baaf6d1c-5939-4b18-bb13-a5dbe09562ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:28.451405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-baaf6d1c-5939-4b18-bb13-a5dbe09562ec tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1503 microversion: 2.1 time: 0.248864 Feb 17 03:28:28.452543 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 178/360] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:28 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:28.457760 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-19f402a3-57e0-44ef-8448-70c2f40549fb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:28.458895 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-19f402a3-57e0-44ef-8448-70c2f40549fb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:28.467703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19f402a3-57e0-44ef-8448-70c2f40549fb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:28.468247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19f402a3-57e0-44ef-8448-70c2f40549fb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:28.469090 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19f402a3-57e0-44ef-8448-70c2f40549fb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:28.469576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19f402a3-57e0-44ef-8448-70c2f40549fb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:28.628307 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-19f402a3-57e0-44ef-8448-70c2f40549fb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28612 microversion: 2.20 time: 0.175533 Feb 17 03:28:28.630630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 183/361] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:28 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28612 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:28:28.809205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-25ea26f5-56b2-4c22-8203-0e69e7bee6fa tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:28.809849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-25ea26f5-56b2-4c22-8203-0e69e7bee6fa tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:28.818348 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25ea26f5-56b2-4c22-8203-0e69e7bee6fa tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:28.818840 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25ea26f5-56b2-4c22-8203-0e69e7bee6fa tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:28.819690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25ea26f5-56b2-4c22-8203-0e69e7bee6fa tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:28.820167 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25ea26f5-56b2-4c22-8203-0e69e7bee6fa tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:29.037514 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-25ea26f5-56b2-4c22-8203-0e69e7bee6fa tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:29.046289 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-25ea26f5-56b2-4c22-8203-0e69e7bee6fa tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.241261 Feb 17 03:28:29.046880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 179/362] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:28 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:29.150071 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-67c50b27-3666-48d3-b83e-12c0c6e18e13 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:29.151219 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-67c50b27-3666-48d3-b83e-12c0c6e18e13 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:29.160437 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-67c50b27-3666-48d3-b83e-12c0c6e18e13 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:29.160948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-67c50b27-3666-48d3-b83e-12c0c6e18e13 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:29.161800 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-67c50b27-3666-48d3-b83e-12c0c6e18e13 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:29.162288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-67c50b27-3666-48d3-b83e-12c0c6e18e13 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:29.425363 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-67c50b27-3666-48d3-b83e-12c0c6e18e13 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28584 microversion: 2.1 time: 0.279546 Feb 17 03:28:29.426139 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 184/363] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:29 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28584 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:29.470492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e037c678-32ee-4458-adf4-e11e50451875 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:29.471411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e037c678-32ee-4458-adf4-e11e50451875 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:29.479326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e037c678-32ee-4458-adf4-e11e50451875 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:29.479874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e037c678-32ee-4458-adf4-e11e50451875 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:29.480704 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e037c678-32ee-4458-adf4-e11e50451875 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:29.481184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e037c678-32ee-4458-adf4-e11e50451875 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:29.641871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ccfdeb9b-423e-4f93-9041-c7bc1ec623a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:29.643009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ccfdeb9b-423e-4f93-9041-c7bc1ec623a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:29.651607 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ccfdeb9b-423e-4f93-9041-c7bc1ec623a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:29.652099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ccfdeb9b-423e-4f93-9041-c7bc1ec623a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:29.652931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ccfdeb9b-423e-4f93-9041-c7bc1ec623a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:29.653418 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ccfdeb9b-423e-4f93-9041-c7bc1ec623a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:29.692920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e037c678-32ee-4458-adf4-e11e50451875 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:29.701629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e037c678-32ee-4458-adf4-e11e50451875 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1503 microversion: 2.1 time: 0.235137 Feb 17 03:28:29.702235 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 180/364] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:29 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1503 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:29.906488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ccfdeb9b-423e-4f93-9041-c7bc1ec623a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28612 microversion: 2.20 time: 0.269303 Feb 17 03:28:29.907123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 185/365] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:29 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28612 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:28:30.064885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c2c71667-8934-4b03-a1ae-f24bd7fd7864 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:30.065901 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c2c71667-8934-4b03-a1ae-f24bd7fd7864 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:30.074249 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c2c71667-8934-4b03-a1ae-f24bd7fd7864 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.074865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c2c71667-8934-4b03-a1ae-f24bd7fd7864 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.076179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c2c71667-8934-4b03-a1ae-f24bd7fd7864 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.076905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c2c71667-8934-4b03-a1ae-f24bd7fd7864 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.206335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-3d911ff6-e9db-4908-8ef3-34a837d0deae req-b6b548ed-c489-4e38-9300-eb1d1f60fe74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e182fd58-23ef-4d1f-9792-d7c21018fda0", "name": "network-vif-unplugged", "status": "completed", "tag": "82d1ec47-2523-4972-a419-d4cd51055be6"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:30.208096 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:30.208096 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:28:30.219056 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-3d911ff6-e9db-4908-8ef3-34a837d0deae req-b6b548ed-c489-4e38-9300-eb1d1f60fe74 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.219810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-3d911ff6-e9db-4908-8ef3-34a837d0deae req-b6b548ed-c489-4e38-9300-eb1d1f60fe74 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.257590 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-3d911ff6-e9db-4908-8ef3-34a837d0deae req-b6b548ed-c489-4e38-9300-eb1d1f60fe74 service nova] Creating event network-vif-unplugged:82d1ec47-2523-4972-a419-d4cd51055be6 for instance e182fd58-23ef-4d1f-9792-d7c21018fda0 on hv-cinder-75996 Feb 17 03:28:30.270521 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-3d911ff6-e9db-4908-8ef3-34a837d0deae req-b6b548ed-c489-4e38-9300-eb1d1f60fe74 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069361 Feb 17 03:28:30.277892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 186/366] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:30 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:30.315921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c2c71667-8934-4b03-a1ae-f24bd7fd7864 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:30.326114 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c2c71667-8934-4b03-a1ae-f24bd7fd7864 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.265010 Feb 17 03:28:30.337617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 181/367] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:30 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:30.438206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f0df4c3c-8c55-4224-8d67-02228cec8ab3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:30.440185 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f0df4c3c-8c55-4224-8d67-02228cec8ab3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:30.448448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f0df4c3c-8c55-4224-8d67-02228cec8ab3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.449048 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f0df4c3c-8c55-4224-8d67-02228cec8ab3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.449994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f0df4c3c-8c55-4224-8d67-02228cec8ab3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.450563 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f0df4c3c-8c55-4224-8d67-02228cec8ab3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.610751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f0df4c3c-8c55-4224-8d67-02228cec8ab3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28584 microversion: 2.1 time: 0.176851 Feb 17 03:28:30.611752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 187/368] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:30 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28584 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:30.719408 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-372110ed-a703-4734-9bd4-c79fba46e20f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:30.720026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-372110ed-a703-4734-9bd4-c79fba46e20f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:30.728257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-372110ed-a703-4734-9bd4-c79fba46e20f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.728752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-372110ed-a703-4734-9bd4-c79fba46e20f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.729581 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-372110ed-a703-4734-9bd4-c79fba46e20f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.730064 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-372110ed-a703-4734-9bd4-c79fba46e20f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.920136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-055b7c7a-8fd3-48df-96ba-6ebcc3287717 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:30.921281 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-055b7c7a-8fd3-48df-96ba-6ebcc3287717 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:30.929978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-055b7c7a-8fd3-48df-96ba-6ebcc3287717 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.930492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-055b7c7a-8fd3-48df-96ba-6ebcc3287717 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.931345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-055b7c7a-8fd3-48df-96ba-6ebcc3287717 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.931866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-055b7c7a-8fd3-48df-96ba-6ebcc3287717 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.947265 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-372110ed-a703-4734-9bd4-c79fba46e20f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:30.956731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-372110ed-a703-4734-9bd4-c79fba46e20f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1503 microversion: 2.1 time: 0.241882 Feb 17 03:28:30.957325 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 182/369] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:30 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1503 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:31.104905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-055b7c7a-8fd3-48df-96ba-6ebcc3287717 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 28941 microversion: 2.20 time: 0.189096 Feb 17 03:28:31.105549 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 188/370] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:30 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 28941 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:31.344874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e7d53fed-0056-4d90-9c4f-a121cca5cf55 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:31.345515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e7d53fed-0056-4d90-9c4f-a121cca5cf55 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:31.354224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e7d53fed-0056-4d90-9c4f-a121cca5cf55 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:31.354962 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e7d53fed-0056-4d90-9c4f-a121cca5cf55 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:31.355803 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e7d53fed-0056-4d90-9c4f-a121cca5cf55 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:31.356291 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e7d53fed-0056-4d90-9c4f-a121cca5cf55 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:31.574513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e7d53fed-0056-4d90-9c4f-a121cca5cf55 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:31.584156 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e7d53fed-0056-4d90-9c4f-a121cca5cf55 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.243286 Feb 17 03:28:31.584949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 183/371] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:31 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:31.623410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e16e9354-ed0d-442b-ad60-cebbc4b8f0fb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:31.624616 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e16e9354-ed0d-442b-ad60-cebbc4b8f0fb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:31.633064 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e16e9354-ed0d-442b-ad60-cebbc4b8f0fb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:31.633572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e16e9354-ed0d-442b-ad60-cebbc4b8f0fb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:31.634414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e16e9354-ed0d-442b-ad60-cebbc4b8f0fb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:31.634906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e16e9354-ed0d-442b-ad60-cebbc4b8f0fb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:31.818220 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e16e9354-ed0d-442b-ad60-cebbc4b8f0fb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28584 microversion: 2.1 time: 0.199044 Feb 17 03:28:31.819005 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 189/372] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:31 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28584 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:31.976092 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-36f19ebf-1543-4e7c-8d42-487fc5d7f790 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:31.976848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-36f19ebf-1543-4e7c-8d42-487fc5d7f790 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:31.984850 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-36f19ebf-1543-4e7c-8d42-487fc5d7f790 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:31.985350 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-36f19ebf-1543-4e7c-8d42-487fc5d7f790 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:31.986182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-36f19ebf-1543-4e7c-8d42-487fc5d7f790 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:31.986665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-36f19ebf-1543-4e7c-8d42-487fc5d7f790 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:32.115813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-36f19ebf-1543-4e7c-8d42-487fc5d7f790 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:32.119352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-45efca7b-88ca-4cde-807e-b2114d31a728 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:32.120925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-45efca7b-88ca-4cde-807e-b2114d31a728 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:32.125524 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-36f19ebf-1543-4e7c-8d42-487fc5d7f790 tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1461 microversion: 2.1 time: 0.154538 Feb 17 03:28:32.126364 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 184/373] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:31 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1461 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:32.130154 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45efca7b-88ca-4cde-807e-b2114d31a728 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:32.130877 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45efca7b-88ca-4cde-807e-b2114d31a728 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:32.131755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45efca7b-88ca-4cde-807e-b2114d31a728 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:32.132243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45efca7b-88ca-4cde-807e-b2114d31a728 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:32.153185 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-cc8c3e90-2a94-49f9-b751-80446edea2b9 req-cc836cbc-2d78-4d17-9a07-2903e42ef7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e182fd58-23ef-4d1f-9792-d7c21018fda0", "name": "network-vif-deleted", "tag": "82d1ec47-2523-4972-a419-d4cd51055be6"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:32.155028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:32.155028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:28:32.164248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-cc8c3e90-2a94-49f9-b751-80446edea2b9 req-cc836cbc-2d78-4d17-9a07-2903e42ef7e2 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:32.164737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-cc8c3e90-2a94-49f9-b751-80446edea2b9 req-cc836cbc-2d78-4d17-9a07-2903e42ef7e2 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:32.186398 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-cc8c3e90-2a94-49f9-b751-80446edea2b9 req-cc836cbc-2d78-4d17-9a07-2903e42ef7e2 service nova] Creating event network-vif-deleted:82d1ec47-2523-4972-a419-d4cd51055be6 for instance e182fd58-23ef-4d1f-9792-d7c21018fda0 on hv-cinder-75996 Feb 17 03:28:32.193256 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-cc8c3e90-2a94-49f9-b751-80446edea2b9 req-cc836cbc-2d78-4d17-9a07-2903e42ef7e2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044271 Feb 17 03:28:32.193921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 185/374] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:28:32.367286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-45efca7b-88ca-4cde-807e-b2114d31a728 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 30085 microversion: 2.20 time: 0.252713 Feb 17 03:28:32.368300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 190/375] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:32 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 30085 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:32.604042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-15bfab51-023a-4fcb-9e57-f336c5b56fa8 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:32.604807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-15bfab51-023a-4fcb-9e57-f336c5b56fa8 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:32.613024 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-15bfab51-023a-4fcb-9e57-f336c5b56fa8 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:32.613522 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-15bfab51-023a-4fcb-9e57-f336c5b56fa8 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:32.614346 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-15bfab51-023a-4fcb-9e57-f336c5b56fa8 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:32.614828 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-15bfab51-023a-4fcb-9e57-f336c5b56fa8 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:32.828572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-15bfab51-023a-4fcb-9e57-f336c5b56fa8 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:32.832430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4d2250b6-654b-4711-b29d-8e81a2ac2290 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:32.833935 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4d2250b6-654b-4711-b29d-8e81a2ac2290 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:32.838660 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-15bfab51-023a-4fcb-9e57-f336c5b56fa8 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.239134 Feb 17 03:28:32.839397 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 186/376] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:32 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:32.842748 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d2250b6-654b-4711-b29d-8e81a2ac2290 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:32.843252 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d2250b6-654b-4711-b29d-8e81a2ac2290 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:32.844118 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d2250b6-654b-4711-b29d-8e81a2ac2290 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:32.844605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d2250b6-654b-4711-b29d-8e81a2ac2290 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.026122 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4d2250b6-654b-4711-b29d-8e81a2ac2290 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28584 microversion: 2.1 time: 0.199076 Feb 17 03:28:33.026845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 191/377] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:32 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28584 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:28:33.147101 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d0e54056-62c1-4c5a-9969-5d3e5d50420c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:33.148045 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d0e54056-62c1-4c5a-9969-5d3e5d50420c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:33.156036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0e54056-62c1-4c5a-9969-5d3e5d50420c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.156709 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0e54056-62c1-4c5a-9969-5d3e5d50420c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.166329 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0e54056-62c1-4c5a-9969-5d3e5d50420c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.166843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0e54056-62c1-4c5a-9969-5d3e5d50420c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.248032 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0e54056-62c1-4c5a-9969-5d3e5d50420c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.248541 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0e54056-62c1-4c5a-9969-5d3e5d50420c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.249285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-d0e54056-62c1-4c5a-9969-5d3e5d50420c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lazy-loading 'fault' on Instance uuid e182fd58-23ef-4d1f-9792-d7c21018fda0 {{(pid=98183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:28:33.318141 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d0e54056-62c1-4c5a-9969-5d3e5d50420c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1d539ce3f64b8fad9994cf919422a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f9108c28e441b4aa6c82ac5f4d640f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:33.326310 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d0e54056-62c1-4c5a-9969-5d3e5d50420c tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 200 len: 1303 microversion: 2.1 time: 0.184866 Feb 17 03:28:33.326969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 187/378] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:33 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 1303 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:33.381368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-47f9aa2b-31b3-4625-bfe4-9b0a35801a58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:33.382632 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-47f9aa2b-31b3-4625-bfe4-9b0a35801a58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:33.392815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-47f9aa2b-31b3-4625-bfe4-9b0a35801a58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.393349 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-47f9aa2b-31b3-4625-bfe4-9b0a35801a58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.394191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-47f9aa2b-31b3-4625-bfe4-9b0a35801a58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.394676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-47f9aa2b-31b3-4625-bfe4-9b0a35801a58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.587237 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-47f9aa2b-31b3-4625-bfe4-9b0a35801a58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 32624 microversion: 2.20 time: 0.210646 Feb 17 03:28:33.587909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 192/379] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:33 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 32624 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:33.858115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a71adb18-e47f-4c31-86fd-1fe20d77a093 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:33.858773 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a71adb18-e47f-4c31-86fd-1fe20d77a093 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:33.868920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a71adb18-e47f-4c31-86fd-1fe20d77a093 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.869424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a71adb18-e47f-4c31-86fd-1fe20d77a093 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.870306 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a71adb18-e47f-4c31-86fd-1fe20d77a093 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.870876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a71adb18-e47f-4c31-86fd-1fe20d77a093 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:34.040236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-86be70bf-b571-452c-9f6e-de7c58d34000 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:34.041561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-86be70bf-b571-452c-9f6e-de7c58d34000 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:34.050648 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-86be70bf-b571-452c-9f6e-de7c58d34000 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:34.051771 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-86be70bf-b571-452c-9f6e-de7c58d34000 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:34.052616 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-86be70bf-b571-452c-9f6e-de7c58d34000 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:34.053105 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-86be70bf-b571-452c-9f6e-de7c58d34000 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:34.090466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a71adb18-e47f-4c31-86fd-1fe20d77a093 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:34.100622 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a71adb18-e47f-4c31-86fd-1fe20d77a093 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.246370 Feb 17 03:28:34.101441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 188/380] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:33 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:34.243229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-86be70bf-b571-452c-9f6e-de7c58d34000 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28584 microversion: 2.1 time: 0.208498 Feb 17 03:28:34.244192 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 193/381] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:34 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28584 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:34.344699 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7cf939c1-b521-4999-80f5-cbd875057f4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:34.345364 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7cf939c1-b521-4999-80f5-cbd875057f4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] [instance: e182fd58-23ef-4d1f-9792-d7c21018fda0] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:34.354634 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7cf939c1-b521-4999-80f5-cbd875057f4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:34.355135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7cf939c1-b521-4999-80f5-cbd875057f4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:34.355990 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7cf939c1-b521-4999-80f5-cbd875057f4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:34.356477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7cf939c1-b521-4999-80f5-cbd875057f4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:34.410423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-7cf939c1-b521-4999-80f5-cbd875057f4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] HTTP exception thrown: Instance e182fd58-23ef-4d1f-9792-d7c21018fda0 could not be found. Feb 17 03:28:34.411762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7cf939c1-b521-4999-80f5-cbd875057f4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] Returning 404 to user: Instance e182fd58-23ef-4d1f-9792-d7c21018fda0 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:28:34.413576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7cf939c1-b521-4999-80f5-cbd875057f4f tempest-VolumesActionsTest-1507301546 tempest-VolumesActionsTest-1507301546-project] 10.222.0.46 "GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0" status: 404 len: 111 microversion: 2.1 time: 0.072635 Feb 17 03:28:34.414393 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 189/382] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:34 2021] GET /compute/v2.1/servers/e182fd58-23ef-4d1f-9792-d7c21018fda0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:28:34.599605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-919f3a86-a771-4818-8b87-28d103083b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:34.600748 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-919f3a86-a771-4818-8b87-28d103083b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:34.609544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-919f3a86-a771-4818-8b87-28d103083b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:34.610103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-919f3a86-a771-4818-8b87-28d103083b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:34.610863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-919f3a86-a771-4818-8b87-28d103083b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:34.611332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-919f3a86-a771-4818-8b87-28d103083b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:34.764375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-919f3a86-a771-4818-8b87-28d103083b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 33122 microversion: 2.20 time: 0.169170 Feb 17 03:28:34.765114 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 194/383] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:34 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 33122 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:35.119676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-de3ca3ad-783d-40a0-9a8d-3bcbe6feab76 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:35.120356 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-de3ca3ad-783d-40a0-9a8d-3bcbe6feab76 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:35.129443 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-de3ca3ad-783d-40a0-9a8d-3bcbe6feab76 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:35.130488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-de3ca3ad-783d-40a0-9a8d-3bcbe6feab76 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:35.131467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-de3ca3ad-783d-40a0-9a8d-3bcbe6feab76 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:35.131796 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-de3ca3ad-783d-40a0-9a8d-3bcbe6feab76 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:35.257018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3d57394e-f039-4d5b-845a-7078e8209c8a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:35.258500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3d57394e-f039-4d5b-845a-7078e8209c8a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:35.277484 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d57394e-f039-4d5b-845a-7078e8209c8a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:35.280953 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d57394e-f039-4d5b-845a-7078e8209c8a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:35.282661 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d57394e-f039-4d5b-845a-7078e8209c8a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:35.286760 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d57394e-f039-4d5b-845a-7078e8209c8a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:35.429197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-de3ca3ad-783d-40a0-9a8d-3bcbe6feab76 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:35.438124 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-de3ca3ad-783d-40a0-9a8d-3bcbe6feab76 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.322638 Feb 17 03:28:35.438803 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 190/384] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:35 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:35.444334 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-510184285", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "networks": [{"uuid": "14692b9d-40c8-4147-9ef2-2084ebbdc286"}]}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:35.464222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3d57394e-f039-4d5b-845a-7078e8209c8a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28584 microversion: 2.1 time: 0.211109 Feb 17 03:28:35.465048 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 195/385] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:35 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28584 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:35.512366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] validate_networks() for [('14692b9d-40c8-4147-9ef2-2084ebbdc286', None, None, None)] {{(pid=98183) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:28:35.777909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b75e8437-ff5d-423a-b267-5ef9b9356c8a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:35.779167 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b75e8437-ff5d-423a-b267-5ef9b9356c8a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:35.788901 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b75e8437-ff5d-423a-b267-5ef9b9356c8a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:35.789128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b75e8437-ff5d-423a-b267-5ef9b9356c8a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:35.790065 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b75e8437-ff5d-423a-b267-5ef9b9356c8a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:35.790677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b75e8437-ff5d-423a-b267-5ef9b9356c8a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.102670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Flavor limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:28:36.103153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Image limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:28:36.103957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Flavor pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:28:36.104416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Image pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:28:36.104871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:28:36.114284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.114790 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.115697 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.116190 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.136481 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Getting quotas for project 0ade3597251b451eb7a31a1c95528adf. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:28:36.140917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Getting quotas for user 41a15644050d496c9d4a641eb5f8f088 and project 0ade3597251b451eb7a31a1c95528adf. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:28:36.152852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Going to run 1 instances... {{(pid=98183) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:28:36.155464 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:28:36.217925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1b3b20ae-059f-4bfe-8643-1b0871e63a73 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777326 Feb 17 03:28:36.223885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 191/386] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:28:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:28:36.232986 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7c5f6dde-c255-4523-ba23-a3ccd2041aa2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:36.233655 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7c5f6dde-c255-4523-ba23-a3ccd2041aa2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:36.320106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7c5f6dde-c255-4523-ba23-a3ccd2041aa2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:36.328783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7c5f6dde-c255-4523-ba23-a3ccd2041aa2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1217 microversion: 2.1 time: 0.099764 Feb 17 03:28:36.329388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 192/387] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:36 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:36.456693 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-faf9713f-579f-47fa-a95e-61fc1c804b1d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:36.457349 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-faf9713f-579f-47fa-a95e-61fc1c804b1d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:36.465319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-faf9713f-579f-47fa-a95e-61fc1c804b1d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.465815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-faf9713f-579f-47fa-a95e-61fc1c804b1d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.466639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-faf9713f-579f-47fa-a95e-61fc1c804b1d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.467133 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-faf9713f-579f-47fa-a95e-61fc1c804b1d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.685479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-faf9713f-579f-47fa-a95e-61fc1c804b1d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:36.694898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-faf9713f-579f-47fa-a95e-61fc1c804b1d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.242308 Feb 17 03:28:36.695489 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 193/388] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:36 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:36.700124 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8850d770-5eba-4b9a-a3e2-8d25a2d91045 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:36.701222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8850d770-5eba-4b9a-a3e2-8d25a2d91045 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:36.709181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8850d770-5eba-4b9a-a3e2-8d25a2d91045 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.709715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8850d770-5eba-4b9a-a3e2-8d25a2d91045 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.710529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8850d770-5eba-4b9a-a3e2-8d25a2d91045 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.711014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8850d770-5eba-4b9a-a3e2-8d25a2d91045 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:38.724091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b75e8437-ff5d-423a-b267-5ef9b9356c8a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 34808 microversion: 2.20 time: 2.950464 Feb 17 03:28:38.724825 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 196/389] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:35 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 34808 bytes in 2953 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:28:38.730269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7039d3ab-6d56-451b-996a-a8a01c50f314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:38.731044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7039d3ab-6d56-451b-996a-a8a01c50f314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:38.740055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7039d3ab-6d56-451b-996a-a8a01c50f314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:38.740563 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7039d3ab-6d56-451b-996a-a8a01c50f314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:38.741410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7039d3ab-6d56-451b-996a-a8a01c50f314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:38.741906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7039d3ab-6d56-451b-996a-a8a01c50f314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:38.762556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8850d770-5eba-4b9a-a3e2-8d25a2d91045 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28584 microversion: 2.1 time: 2.065590 Feb 17 03:28:38.766685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 194/390] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:36 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28584 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:38.768502 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-65ef71a6-7598-47ff-ab6b-d9134a1dd868 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:38.769258 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-65ef71a6-7598-47ff-ab6b-d9134a1dd868 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:38.784027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-65ef71a6-7598-47ff-ab6b-d9134a1dd868 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:38.784741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-65ef71a6-7598-47ff-ab6b-d9134a1dd868 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:38.785753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-65ef71a6-7598-47ff-ab6b-d9134a1dd868 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:38.786411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-65ef71a6-7598-47ff-ab6b-d9134a1dd868 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:38.880543 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7039d3ab-6d56-451b-996a-a8a01c50f314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:38.889343 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7039d3ab-6d56-451b-996a-a8a01c50f314 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1221 microversion: 2.1 time: 0.163241 Feb 17 03:28:38.890015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 197/391] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:38 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1221 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:39.012989 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-65ef71a6-7598-47ff-ab6b-d9134a1dd868 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:39.022015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-65ef71a6-7598-47ff-ab6b-d9134a1dd868 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.257611 Feb 17 03:28:39.022615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 195/392] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:38 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:39.736351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ed3b8edc-0f3e-482e-957b-be4039bd86d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:39.737379 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ed3b8edc-0f3e-482e-957b-be4039bd86d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:39.749198 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ed3b8edc-0f3e-482e-957b-be4039bd86d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:39.749695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ed3b8edc-0f3e-482e-957b-be4039bd86d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:39.750553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ed3b8edc-0f3e-482e-957b-be4039bd86d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:39.751075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ed3b8edc-0f3e-482e-957b-be4039bd86d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:39.775222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-09ddef9e-1cdf-4fff-80ea-5e71a6cc7371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:39.776293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-09ddef9e-1cdf-4fff-80ea-5e71a6cc7371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:39.784577 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-09ddef9e-1cdf-4fff-80ea-5e71a6cc7371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:39.785079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-09ddef9e-1cdf-4fff-80ea-5e71a6cc7371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:39.785905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-09ddef9e-1cdf-4fff-80ea-5e71a6cc7371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:39.786391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-09ddef9e-1cdf-4fff-80ea-5e71a6cc7371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:42.421853 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-09ddef9e-1cdf-4fff-80ea-5e71a6cc7371 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28584 microversion: 2.1 time: 2.651068 Feb 17 03:28:42.422541 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 196/393] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:39 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28584 bytes in 2653 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:42.428439 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9bd6dfeb-83b4-43b4-980f-58687fd906b8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:42.429195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9bd6dfeb-83b4-43b4-980f-58687fd906b8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:42.437453 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bd6dfeb-83b4-43b4-980f-58687fd906b8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:42.437959 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bd6dfeb-83b4-43b4-980f-58687fd906b8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:42.438788 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bd6dfeb-83b4-43b4-980f-58687fd906b8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:42.439270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bd6dfeb-83b4-43b4-980f-58687fd906b8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:42.453085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ed3b8edc-0f3e-482e-957b-be4039bd86d2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 36996 microversion: 2.20 time: 2.720267 Feb 17 03:28:42.454624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 198/394] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:39 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 36996 bytes in 2722 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:42.460062 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7d72be15-d6dc-42ef-bbc7-7f512e535ef1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:42.460831 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7d72be15-d6dc-42ef-bbc7-7f512e535ef1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:42.471464 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7d72be15-d6dc-42ef-bbc7-7f512e535ef1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:42.473602 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7d72be15-d6dc-42ef-bbc7-7f512e535ef1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:42.474540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7d72be15-d6dc-42ef-bbc7-7f512e535ef1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:42.475424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7d72be15-d6dc-42ef-bbc7-7f512e535ef1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:42.577472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9bd6dfeb-83b4-43b4-980f-58687fd906b8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:42.589302 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9bd6dfeb-83b4-43b4-980f-58687fd906b8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1277 microversion: 2.1 time: 0.165481 Feb 17 03:28:42.590801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 197/395] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:42 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:42.714905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7d72be15-d6dc-42ef-bbc7-7f512e535ef1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:42.725148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7d72be15-d6dc-42ef-bbc7-7f512e535ef1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.269505 Feb 17 03:28:42.727583 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 199/396] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:42 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:43.434559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-88175a4f-166e-448c-9faa-1de082b67cdf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:43.435666 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-88175a4f-166e-448c-9faa-1de082b67cdf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:43.444341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-88175a4f-166e-448c-9faa-1de082b67cdf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.444881 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-88175a4f-166e-448c-9faa-1de082b67cdf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.445841 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-88175a4f-166e-448c-9faa-1de082b67cdf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.446319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-88175a4f-166e-448c-9faa-1de082b67cdf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.466674 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-05ba2528-b4d1-4439-9f2b-56bb6f1fd14a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:43.467830 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-05ba2528-b4d1-4439-9f2b-56bb6f1fd14a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:43.476553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-05ba2528-b4d1-4439-9f2b-56bb6f1fd14a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.477066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-05ba2528-b4d1-4439-9f2b-56bb6f1fd14a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.477935 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-05ba2528-b4d1-4439-9f2b-56bb6f1fd14a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.478440 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-05ba2528-b4d1-4439-9f2b-56bb6f1fd14a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:46.013243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-88175a4f-166e-448c-9faa-1de082b67cdf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28584 microversion: 2.1 time: 2.582420 Feb 17 03:28:46.015036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 198/397] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:43 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28584 bytes in 2585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:46.020595 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cca5e519-5251-4100-b179-6213e50f3356 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:46.021354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cca5e519-5251-4100-b179-6213e50f3356 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:46.029853 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cca5e519-5251-4100-b179-6213e50f3356 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:46.030360 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cca5e519-5251-4100-b179-6213e50f3356 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:46.031194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cca5e519-5251-4100-b179-6213e50f3356 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:46.031706 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cca5e519-5251-4100-b179-6213e50f3356 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:46.066743 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-05ba2528-b4d1-4439-9f2b-56bb6f1fd14a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 38111 microversion: 2.20 time: 2.603926 Feb 17 03:28:46.072949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 200/398] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:43 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 38111 bytes in 2611 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:46.078557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-008aae91-5118-4fe8-9b08-fa2439339954 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:46.080476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-008aae91-5118-4fe8-9b08-fa2439339954 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:46.088840 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-008aae91-5118-4fe8-9b08-fa2439339954 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:46.089352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-008aae91-5118-4fe8-9b08-fa2439339954 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:46.090229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-008aae91-5118-4fe8-9b08-fa2439339954 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:46.090714 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-008aae91-5118-4fe8-9b08-fa2439339954 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:46.395074 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-008aae91-5118-4fe8-9b08-fa2439339954 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:46.404266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-008aae91-5118-4fe8-9b08-fa2439339954 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.329812 Feb 17 03:28:46.404968 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 201/399] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:46 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:46.455698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cca5e519-5251-4100-b179-6213e50f3356 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:46.464568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cca5e519-5251-4100-b179-6213e50f3356 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.448118 Feb 17 03:28:46.465446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 199/400] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:46 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:47.026327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3cfb9f26-60d8-4560-adaf-245c97c8748b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:47.027368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3cfb9f26-60d8-4560-adaf-245c97c8748b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:47.035203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3cfb9f26-60d8-4560-adaf-245c97c8748b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.035751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3cfb9f26-60d8-4560-adaf-245c97c8748b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.036582 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3cfb9f26-60d8-4560-adaf-245c97c8748b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.037073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3cfb9f26-60d8-4560-adaf-245c97c8748b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.080598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d825ff5d-7941-449b-9dc4-fa38d2ca0df9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:47.081679 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d825ff5d-7941-449b-9dc4-fa38d2ca0df9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:47.094242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d825ff5d-7941-449b-9dc4-fa38d2ca0df9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.094742 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d825ff5d-7941-449b-9dc4-fa38d2ca0df9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.095588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d825ff5d-7941-449b-9dc4-fa38d2ca0df9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.096335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d825ff5d-7941-449b-9dc4-fa38d2ca0df9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.448429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3cfb9f26-60d8-4560-adaf-245c97c8748b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28584 microversion: 2.1 time: 0.426284 Feb 17 03:28:47.449076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 202/401] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:47 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28584 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:47.454488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-7d5e4c2f-81a6-4a5d-8fa6-1f8e3d017b2d req-fd847840-9159-44df-a15e-f2d2dde61107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08114034-f862-4a9a-a372-755e2b9a8b2f", "tag": "62f4a7fe-8e9b-45c2-a79a-667070ef1221"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:47.456109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:47.456109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:28:47.466077 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-7d5e4c2f-81a6-4a5d-8fa6-1f8e3d017b2d req-fd847840-9159-44df-a15e-f2d2dde61107 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.466580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-7d5e4c2f-81a6-4a5d-8fa6-1f8e3d017b2d req-fd847840-9159-44df-a15e-f2d2dde61107 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.473538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d825ff5d-7941-449b-9dc4-fa38d2ca0df9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 38111 microversion: 2.20 time: 0.396661 Feb 17 03:28:47.476294 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 200/402] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:47 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 38111 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:47.479652 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3c6b34db-0ad8-45a2-9e5d-69aeb5e77f59 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:47.480409 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3c6b34db-0ad8-45a2-9e5d-69aeb5e77f59 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:47.487444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-7d5e4c2f-81a6-4a5d-8fa6-1f8e3d017b2d req-fd847840-9159-44df-a15e-f2d2dde61107 service nova] Creating event network-changed:62f4a7fe-8e9b-45c2-a79a-667070ef1221 for instance 08114034-f862-4a9a-a372-755e2b9a8b2f on hv-cinder-75996 Feb 17 03:28:47.489023 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c6b34db-0ad8-45a2-9e5d-69aeb5e77f59 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.489527 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c6b34db-0ad8-45a2-9e5d-69aeb5e77f59 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.490870 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c6b34db-0ad8-45a2-9e5d-69aeb5e77f59 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.491498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c6b34db-0ad8-45a2-9e5d-69aeb5e77f59 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.493610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-7d5e4c2f-81a6-4a5d-8fa6-1f8e3d017b2d req-fd847840-9159-44df-a15e-f2d2dde61107 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042748 Feb 17 03:28:47.494273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 203/403] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:47.499504 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5dcfa19b-b41d-4f87-a011-3925c0d9f9d7 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:47.500288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5dcfa19b-b41d-4f87-a011-3925c0d9f9d7 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:47.508863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5dcfa19b-b41d-4f87-a011-3925c0d9f9d7 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.509380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5dcfa19b-b41d-4f87-a011-3925c0d9f9d7 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.510214 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5dcfa19b-b41d-4f87-a011-3925c0d9f9d7 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.510705 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5dcfa19b-b41d-4f87-a011-3925c0d9f9d7 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.856468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3c6b34db-0ad8-45a2-9e5d-69aeb5e77f59 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:47.861625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5dcfa19b-b41d-4f87-a011-3925c0d9f9d7 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:47.867155 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3c6b34db-0ad8-45a2-9e5d-69aeb5e77f59 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.391567 Feb 17 03:28:47.868026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 201/404] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:47 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:47.878086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5dcfa19b-b41d-4f87-a011-3925c0d9f9d7 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.379688 Feb 17 03:28:47.878086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 204/405] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:47 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:48.462535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b6799090-3ac0-4223-8f1b-873884ed461f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:48.464838 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b6799090-3ac0-4223-8f1b-873884ed461f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:48.482264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6799090-3ac0-4223-8f1b-873884ed461f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:48.483608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6799090-3ac0-4223-8f1b-873884ed461f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:48.485280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6799090-3ac0-4223-8f1b-873884ed461f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:48.486027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6799090-3ac0-4223-8f1b-873884ed461f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:48.487546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-00eb6fa1-3269-4de3-b68d-408ff8ca2ae4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:48.488623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-00eb6fa1-3269-4de3-b68d-408ff8ca2ae4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:48.512644 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-00eb6fa1-3269-4de3-b68d-408ff8ca2ae4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:48.513387 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-00eb6fa1-3269-4de3-b68d-408ff8ca2ae4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:48.514429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-00eb6fa1-3269-4de3-b68d-408ff8ca2ae4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:48.515069 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-00eb6fa1-3269-4de3-b68d-408ff8ca2ae4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:51.896238 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b6799090-3ac0-4223-8f1b-873884ed461f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28584 microversion: 2.1 time: 3.439873 Feb 17 03:28:51.897670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 205/406] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:48 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28584 bytes in 3443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:51.903092 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c28e75ff-eaaf-49a8-a2fb-34074560b2c2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:51.903869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c28e75ff-eaaf-49a8-a2fb-34074560b2c2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:51.912350 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c28e75ff-eaaf-49a8-a2fb-34074560b2c2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:51.912851 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c28e75ff-eaaf-49a8-a2fb-34074560b2c2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:51.913671 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c28e75ff-eaaf-49a8-a2fb-34074560b2c2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:51.914157 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c28e75ff-eaaf-49a8-a2fb-34074560b2c2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:51.954750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-00eb6fa1-3269-4de3-b68d-408ff8ca2ae4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 200 len: 38251 microversion: 2.20 time: 3.470735 Feb 17 03:28:51.963321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 202/407] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:48 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 38251 bytes in 3474 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:51.971064 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9953fb1d-53c1-4265-a533-0386d7a71acc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:51.980799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9953fb1d-53c1-4265-a533-0386d7a71acc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:52.000091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9953fb1d-53c1-4265-a533-0386d7a71acc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.000905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9953fb1d-53c1-4265-a533-0386d7a71acc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.002133 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9953fb1d-53c1-4265-a533-0386d7a71acc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.003152 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9953fb1d-53c1-4265-a533-0386d7a71acc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.339110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c28e75ff-eaaf-49a8-a2fb-34074560b2c2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:52.352125 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c28e75ff-eaaf-49a8-a2fb-34074560b2c2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.452751 Feb 17 03:28:52.353024 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 206/408] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:51 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:52.358973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e29988a1-da47-4435-8ffc-f714c3b39106 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:52.359787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e29988a1-da47-4435-8ffc-f714c3b39106 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:52.377512 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e29988a1-da47-4435-8ffc-f714c3b39106 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.378094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e29988a1-da47-4435-8ffc-f714c3b39106 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.378842 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e29988a1-da47-4435-8ffc-f714c3b39106 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.379346 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e29988a1-da47-4435-8ffc-f714c3b39106 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.395586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9953fb1d-53c1-4265-a533-0386d7a71acc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:52.405721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9953fb1d-53c1-4265-a533-0386d7a71acc tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.440480 Feb 17 03:28:52.411695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 203/409] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:51 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:52.447282 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e29988a1-da47-4435-8ffc-f714c3b39106 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/ips" status: 200 len: 151 microversion: 2.20 time: 0.092846 Feb 17 03:28:52.455434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 207/410] 10.222.0.46 () {60 vars in 1279 bytes} [Wed Feb 17 03:28:52 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/ips => generated 151 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:52.909287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-61d1e3d6-1333-47b2-b2d3-5a84c05f62d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:52.910354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-61d1e3d6-1333-47b2-b2d3-5a84c05f62d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:52.925929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-61d1e3d6-1333-47b2-b2d3-5a84c05f62d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.926621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-61d1e3d6-1333-47b2-b2d3-5a84c05f62d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.929737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-61d1e3d6-1333-47b2-b2d3-5a84c05f62d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.930435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-61d1e3d6-1333-47b2-b2d3-5a84c05f62d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:53.241619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-61d1e3d6-1333-47b2-b2d3-5a84c05f62d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 28957 microversion: 2.1 time: 0.335589 Feb 17 03:28:53.242624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 204/411] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:52 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 28957 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:53.370556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a57dee21-1b90-4366-ab69-866e49b00f36 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:53.371218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a57dee21-1b90-4366-ab69-866e49b00f36 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:53.379464 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a57dee21-1b90-4366-ab69-866e49b00f36 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:53.380028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a57dee21-1b90-4366-ab69-866e49b00f36 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:53.381336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a57dee21-1b90-4366-ab69-866e49b00f36 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:53.381829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a57dee21-1b90-4366-ab69-866e49b00f36 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:53.425482 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-442c432c-8712-4bd4-9d03-9645ce9784e3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:53.426235 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-442c432c-8712-4bd4-9d03-9645ce9784e3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:53.434888 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-442c432c-8712-4bd4-9d03-9645ce9784e3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:53.435386 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-442c432c-8712-4bd4-9d03-9645ce9784e3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:53.436225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-442c432c-8712-4bd4-9d03-9645ce9784e3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:53.436707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-442c432c-8712-4bd4-9d03-9645ce9784e3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:53.873063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a57dee21-1b90-4366-ab69-866e49b00f36 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:53.883653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a57dee21-1b90-4366-ab69-866e49b00f36 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1500 microversion: 2.1 time: 0.516989 Feb 17 03:28:53.884573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 208/412] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:53 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1500 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:53.903928 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-29e23870-668a-4e4f-a6cc-aa32b5b95d5f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6edc229-4c65-417f-9dca-d7435538d8e5"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:53.905225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-29e23870-668a-4e4f-a6cc-aa32b5b95d5f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:53.914197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-29e23870-668a-4e4f-a6cc-aa32b5b95d5f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:53.915325 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-29e23870-668a-4e4f-a6cc-aa32b5b95d5f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:53.916726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-29e23870-668a-4e4f-a6cc-aa32b5b95d5f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:53.917430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-29e23870-668a-4e4f-a6cc-aa32b5b95d5f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:53.948295 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-442c432c-8712-4bd4-9d03-9645ce9784e3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:53.958352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-442c432c-8712-4bd4-9d03-9645ce9784e3 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.537357 Feb 17 03:28:53.960134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 205/413] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:53 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:54.012340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-29e23870-668a-4e4f-a6cc-aa32b5b95d5f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] HTTP exception thrown: Cannot 'attach_volume' instance 6ec09d11-1456-48e6-9b4a-cbb0c7775f78 while it is in vm_state rescued Feb 17 03:28:54.013000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-29e23870-668a-4e4f-a6cc-aa32b5b95d5f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Returning 409 to user: Cannot 'attach_volume' instance 6ec09d11-1456-48e6-9b4a-cbb0c7775f78 while it is in vm_state rescued {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:28:54.014912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-29e23870-668a-4e4f-a6cc-aa32b5b95d5f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "POST /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.114334 Feb 17 03:28:54.014912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 209/414] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:28:53 2021] POST /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/os-volume_attachments => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 17 03:28:54.029596 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fabc7667-cbb9-4f89-8426-0547c6606685 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:54.030142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fabc7667-cbb9-4f89-8426-0547c6606685 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:54.042629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fabc7667-cbb9-4f89-8426-0547c6606685 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.043933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fabc7667-cbb9-4f89-8426-0547c6606685 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.045823 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fabc7667-cbb9-4f89-8426-0547c6606685 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.046911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fabc7667-cbb9-4f89-8426-0547c6606685 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.250948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fabc7667-cbb9-4f89-8426-0547c6606685 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "POST /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/action" status: 202 len: 0 microversion: 2.1 time: 0.225935 Feb 17 03:28:54.251657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 206/415] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:54 2021] POST /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:54.256561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cbe9dbdb-47fb-48f8-abe1-70bae9c77420 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:54.257630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cbe9dbdb-47fb-48f8-abe1-70bae9c77420 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:54.265445 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1ec8e823-f3f2-4eb9-9c74-76c69570bf96 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:54.266154 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cbe9dbdb-47fb-48f8-abe1-70bae9c77420 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.266287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1ec8e823-f3f2-4eb9-9c74-76c69570bf96 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:54.266663 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cbe9dbdb-47fb-48f8-abe1-70bae9c77420 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.267500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cbe9dbdb-47fb-48f8-abe1-70bae9c77420 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.268852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cbe9dbdb-47fb-48f8-abe1-70bae9c77420 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.277538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1ec8e823-f3f2-4eb9-9c74-76c69570bf96 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.278713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1ec8e823-f3f2-4eb9-9c74-76c69570bf96 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.281188 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1ec8e823-f3f2-4eb9-9c74-76c69570bf96 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.281594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1ec8e823-f3f2-4eb9-9c74-76c69570bf96 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.479857 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cbe9dbdb-47fb-48f8-abe1-70bae9c77420 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 30458 microversion: 2.1 time: 0.228817 Feb 17 03:28:54.480676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 210/416] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:54 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 30458 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:54.529227 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1ec8e823-f3f2-4eb9-9c74-76c69570bf96 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:54.538284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1ec8e823-f3f2-4eb9-9c74-76c69570bf96 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1508 microversion: 2.1 time: 0.278251 Feb 17 03:28:54.551604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 207/417] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:54 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:54.978294 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b6108ab7-a43e-490a-9ef3-5629169a95b0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:54.979192 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b6108ab7-a43e-490a-9ef3-5629169a95b0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:54.987822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6108ab7-a43e-490a-9ef3-5629169a95b0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.988332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6108ab7-a43e-490a-9ef3-5629169a95b0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.989215 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6108ab7-a43e-490a-9ef3-5629169a95b0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.989703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b6108ab7-a43e-490a-9ef3-5629169a95b0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:55.257736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b6108ab7-a43e-490a-9ef3-5629169a95b0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:55.267588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b6108ab7-a43e-490a-9ef3-5629169a95b0 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.294246 Feb 17 03:28:55.268248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 211/418] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:54 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:55.493145 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fb17f7eb-4509-45cf-b28a-fc41b34b9c21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:55.494576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fb17f7eb-4509-45cf-b28a-fc41b34b9c21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:55.502712 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fb17f7eb-4509-45cf-b28a-fc41b34b9c21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:55.503564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fb17f7eb-4509-45cf-b28a-fc41b34b9c21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:55.504870 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fb17f7eb-4509-45cf-b28a-fc41b34b9c21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:55.505549 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fb17f7eb-4509-45cf-b28a-fc41b34b9c21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:55.565863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2408a04e-17d2-4102-b6ae-c4ba0a047777 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:55.566535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2408a04e-17d2-4102-b6ae-c4ba0a047777 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:55.577315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2408a04e-17d2-4102-b6ae-c4ba0a047777 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:55.577835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2408a04e-17d2-4102-b6ae-c4ba0a047777 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:55.578691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2408a04e-17d2-4102-b6ae-c4ba0a047777 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:55.579189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2408a04e-17d2-4102-b6ae-c4ba0a047777 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:55.727812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fb17f7eb-4509-45cf-b28a-fc41b34b9c21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 31110 microversion: 2.1 time: 0.239002 Feb 17 03:28:55.728880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 208/419] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:55 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 31110 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:55.806597 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e431dc73-8165-4a48-92fd-074219ac6b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:55.807657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e431dc73-8165-4a48-92fd-074219ac6b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:55.824239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2408a04e-17d2-4102-b6ae-c4ba0a047777 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:55.836529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2408a04e-17d2-4102-b6ae-c4ba0a047777 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1508 microversion: 2.1 time: 0.274582 Feb 17 03:28:55.836728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e431dc73-8165-4a48-92fd-074219ac6b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:55.837272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e431dc73-8165-4a48-92fd-074219ac6b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:55.837997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 212/420] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:55 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:55.838160 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e431dc73-8165-4a48-92fd-074219ac6b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:55.838657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e431dc73-8165-4a48-92fd-074219ac6b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:55.982383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-e431dc73-8165-4a48-92fd-074219ac6b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lazy-loading 'flavor' on Instance uuid a89d14a3-493e-413a-918e-fd2de544e689 {{(pid=98183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:28:56.286678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2b990d66-53a4-49ab-bb0e-2ed15d7dd124 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:56.287481 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2b990d66-53a4-49ab-bb0e-2ed15d7dd124 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:56.295717 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2b990d66-53a4-49ab-bb0e-2ed15d7dd124 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.296216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2b990d66-53a4-49ab-bb0e-2ed15d7dd124 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.297037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2b990d66-53a4-49ab-bb0e-2ed15d7dd124 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.297522 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2b990d66-53a4-49ab-bb0e-2ed15d7dd124 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.353165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e431dc73-8165-4a48-92fd-074219ac6b69 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 202 len: 0 microversion: 2.20 time: 0.551139 Feb 17 03:28:56.357321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 209/421] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:55 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:28:56.364027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-821bf1e5-cfd5-4b57-b344-c61792fa3549 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:56.364784 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-821bf1e5-cfd5-4b57-b344-c61792fa3549 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:56.374210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-821bf1e5-cfd5-4b57-b344-c61792fa3549 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.374709 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-821bf1e5-cfd5-4b57-b344-c61792fa3549 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.375636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-821bf1e5-cfd5-4b57-b344-c61792fa3549 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.376217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-821bf1e5-cfd5-4b57-b344-c61792fa3549 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.630561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2b990d66-53a4-49ab-bb0e-2ed15d7dd124 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:56.648902 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2b990d66-53a4-49ab-bb0e-2ed15d7dd124 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.365915 Feb 17 03:28:56.649076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-821bf1e5-cfd5-4b57-b344-c61792fa3549 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:56.650782 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 213/422] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:56 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:56.658618 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4d0f32c4-6e3a-4d19-b90d-4c439e3800c7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:56.659535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4d0f32c4-6e3a-4d19-b90d-4c439e3800c7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:56.661801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-821bf1e5-cfd5-4b57-b344-c61792fa3549 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:56.667126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-821bf1e5-cfd5-4b57-b344-c61792fa3549 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:56.668487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-821bf1e5-cfd5-4b57-b344-c61792fa3549 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.309672 Feb 17 03:28:56.669629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d0f32c4-6e3a-4d19-b90d-4c439e3800c7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.670485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 210/423] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:56 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:56.670600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d0f32c4-6e3a-4d19-b90d-4c439e3800c7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.673301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d0f32c4-6e3a-4d19-b90d-4c439e3800c7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.674560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d0f32c4-6e3a-4d19-b90d-4c439e3800c7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.741013 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3acb7d43-5a28-4818-9938-e9e9658249d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:56.742508 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3acb7d43-5a28-4818-9938-e9e9658249d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:56.760670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3acb7d43-5a28-4818-9938-e9e9658249d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.763084 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3acb7d43-5a28-4818-9938-e9e9658249d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.764331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3acb7d43-5a28-4818-9938-e9e9658249d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.764822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3acb7d43-5a28-4818-9938-e9e9658249d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.886596 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-4d0f32c4-6e3a-4d19-b90d-4c439e3800c7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lazy-loading 'services' on Instance uuid caa71048-be77-41c2-9f9c-ff388c8c3445 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:28:57.064249 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4d0f32c4-6e3a-4d19-b90d-4c439e3800c7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "DELETE /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445/os-volume_attachments/a56050d4-cd25-491d-b5c8-e0039fe7a73b" status: 202 len: 0 microversion: 2.1 time: 0.411283 Feb 17 03:28:57.068554 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 214/424] 10.222.0.46 () {58 vars in 1406 bytes} [Wed Feb 17 03:28:56 2021] DELETE /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445/os-volume_attachments/a56050d4-cd25-491d-b5c8-e0039fe7a73b => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:28:57.074331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-59a22521-c901-4fe3-9f7e-230c056c91b1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:57.075112 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-59a22521-c901-4fe3-9f7e-230c056c91b1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:57.083922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-59a22521-c901-4fe3-9f7e-230c056c91b1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.084399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-59a22521-c901-4fe3-9f7e-230c056c91b1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.085320 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-59a22521-c901-4fe3-9f7e-230c056c91b1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.085820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-59a22521-c901-4fe3-9f7e-230c056c91b1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.340368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-59a22521-c901-4fe3-9f7e-230c056c91b1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:57.350243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-59a22521-c901-4fe3-9f7e-230c056c91b1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1508 microversion: 2.1 time: 0.279829 Feb 17 03:28:57.350860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 215/425] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:57 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:57.666519 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-83763a38-e40d-4815-802c-afc00be5acb2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:57.667287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-83763a38-e40d-4815-802c-afc00be5acb2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:57.675597 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83763a38-e40d-4815-802c-afc00be5acb2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.676099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83763a38-e40d-4815-802c-afc00be5acb2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.676927 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83763a38-e40d-4815-802c-afc00be5acb2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.677410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83763a38-e40d-4815-802c-afc00be5acb2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.904499 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-83763a38-e40d-4815-802c-afc00be5acb2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:57.915274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-83763a38-e40d-4815-802c-afc00be5acb2 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.252690 Feb 17 03:28:57.916042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 216/426] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:57 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:57.921231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7317c2ea-c89f-41e0-8a11-559ac9af036e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:57.923129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7317c2ea-c89f-41e0-8a11-559ac9af036e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:57.934730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7317c2ea-c89f-41e0-8a11-559ac9af036e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.935334 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7317c2ea-c89f-41e0-8a11-559ac9af036e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.936416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7317c2ea-c89f-41e0-8a11-559ac9af036e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.937538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7317c2ea-c89f-41e0-8a11-559ac9af036e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:58.212422 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7317c2ea-c89f-41e0-8a11-559ac9af036e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:58.223758 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7317c2ea-c89f-41e0-8a11-559ac9af036e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:58.225598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7317c2ea-c89f-41e0-8a11-559ac9af036e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:58.227538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7317c2ea-c89f-41e0-8a11-559ac9af036e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.309570 Feb 17 03:28:58.228338 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 217/427] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:57 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:58.374195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-25c72722-91fd-4eba-8767-cd4fa315fdb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:58.374384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-25c72722-91fd-4eba-8767-cd4fa315fdb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:58.383431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25c72722-91fd-4eba-8767-cd4fa315fdb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:58.383997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25c72722-91fd-4eba-8767-cd4fa315fdb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:58.384926 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25c72722-91fd-4eba-8767-cd4fa315fdb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:58.385300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25c72722-91fd-4eba-8767-cd4fa315fdb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:58.646360 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-25c72722-91fd-4eba-8767-cd4fa315fdb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:58.662539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-25c72722-91fd-4eba-8767-cd4fa315fdb6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1508 microversion: 2.1 time: 0.291911 Feb 17 03:28:58.673626 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 218/428] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:58 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1508 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:58.937852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ed31f25d-9059-4736-bfac-a52b4a9ffdeb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:58.939308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ed31f25d-9059-4736-bfac-a52b4a9ffdeb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:58.949761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ed31f25d-9059-4736-bfac-a52b4a9ffdeb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:58.950266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ed31f25d-9059-4736-bfac-a52b4a9ffdeb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:58.951098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ed31f25d-9059-4736-bfac-a52b4a9ffdeb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:58.951611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ed31f25d-9059-4736-bfac-a52b4a9ffdeb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:59.201522 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ed31f25d-9059-4736-bfac-a52b4a9ffdeb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:59.218972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ed31f25d-9059-4736-bfac-a52b4a9ffdeb tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.288437 Feb 17 03:28:59.220707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 219/429] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:58 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:59.248561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b1d118fa-5e9e-4167-a72c-39f0653f27ab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:59.249515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b1d118fa-5e9e-4167-a72c-39f0653f27ab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:59.266617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1d118fa-5e9e-4167-a72c-39f0653f27ab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:59.267133 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1d118fa-5e9e-4167-a72c-39f0653f27ab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:59.268016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1d118fa-5e9e-4167-a72c-39f0653f27ab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:59.268615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1d118fa-5e9e-4167-a72c-39f0653f27ab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:59.540946 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b1d118fa-5e9e-4167-a72c-39f0653f27ab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:59.555038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b1d118fa-5e9e-4167-a72c-39f0653f27ab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:59.556730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b1d118fa-5e9e-4167-a72c-39f0653f27ab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:59.557883 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b1d118fa-5e9e-4167-a72c-39f0653f27ab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.313670 Feb 17 03:28:59.558468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 220/430] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:59 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:59.682206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f3419962-0b87-4eba-9cb8-3abd85d6242d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:59.682866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f3419962-0b87-4eba-9cb8-3abd85d6242d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:59.692144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f3419962-0b87-4eba-9cb8-3abd85d6242d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:59.692779 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f3419962-0b87-4eba-9cb8-3abd85d6242d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:59.694327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f3419962-0b87-4eba-9cb8-3abd85d6242d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:59.694924 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f3419962-0b87-4eba-9cb8-3abd85d6242d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:59.918142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f3419962-0b87-4eba-9cb8-3abd85d6242d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:59.927029 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f3419962-0b87-4eba-9cb8-3abd85d6242d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1508 microversion: 2.1 time: 0.249418 Feb 17 03:28:59.936138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 221/431] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:59 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:00.097534 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3acb7d43-5a28-4818-9938-e9e9658249d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 33187 microversion: 2.1 time: 3.360702 Feb 17 03:29:00.098848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 211/432] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:56 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 33187 bytes in 3362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:29:00.237957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-dc51d988-6b33-4ac7-9d94-36cbdc468cf5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:00.238603 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-dc51d988-6b33-4ac7-9d94-36cbdc468cf5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:00.250665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dc51d988-6b33-4ac7-9d94-36cbdc468cf5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.251220 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dc51d988-6b33-4ac7-9d94-36cbdc468cf5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.252110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dc51d988-6b33-4ac7-9d94-36cbdc468cf5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.252681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dc51d988-6b33-4ac7-9d94-36cbdc468cf5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.483361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-dc51d988-6b33-4ac7-9d94-36cbdc468cf5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:00.493953 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-dc51d988-6b33-4ac7-9d94-36cbdc468cf5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.259923 Feb 17 03:29:00.495593 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 222/433] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:00 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:00.579688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1f817f58-1972-426b-851f-334475666793 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:00.580462 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1f817f58-1972-426b-851f-334475666793 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:00.590273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f817f58-1972-426b-851f-334475666793 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.591972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f817f58-1972-426b-851f-334475666793 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.593645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f817f58-1972-426b-851f-334475666793 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.594528 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f817f58-1972-426b-851f-334475666793 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.833113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1f817f58-1972-426b-851f-334475666793 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:00.843720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1f817f58-1972-426b-851f-334475666793 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:00.845273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1f817f58-1972-426b-851f-334475666793 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:00.846744 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1f817f58-1972-426b-851f-334475666793 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.271388 Feb 17 03:29:00.847339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 212/434] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:00 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:00.946119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1d9687e2-1051-41c4-bd38-01f78ee1e797 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:00.947089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1d9687e2-1051-41c4-bd38-01f78ee1e797 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:00.956468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d9687e2-1051-41c4-bd38-01f78ee1e797 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.958084 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d9687e2-1051-41c4-bd38-01f78ee1e797 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.959385 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d9687e2-1051-41c4-bd38-01f78ee1e797 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.960097 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d9687e2-1051-41c4-bd38-01f78ee1e797 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:01.070538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-390b9e54-5363-467b-acb2-e28febc9736f req-e25b00d7-2098-4e18-8bd3-02408ebd3fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08114034-f862-4a9a-a372-755e2b9a8b2f", "name": "network-vif-plugged", "status": "completed", "tag": "62f4a7fe-8e9b-45c2-a79a-667070ef1221"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:01.074412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:01.074412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:29:01.090355 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-390b9e54-5363-467b-acb2-e28febc9736f req-e25b00d7-2098-4e18-8bd3-02408ebd3fad service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:01.091117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-390b9e54-5363-467b-acb2-e28febc9736f req-e25b00d7-2098-4e18-8bd3-02408ebd3fad service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:01.114695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-390b9e54-5363-467b-acb2-e28febc9736f req-e25b00d7-2098-4e18-8bd3-02408ebd3fad service nova] Creating event network-vif-plugged:62f4a7fe-8e9b-45c2-a79a-667070ef1221 for instance 08114034-f862-4a9a-a372-755e2b9a8b2f on hv-cinder-75996 Feb 17 03:29:01.120532 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-390b9e54-5363-467b-acb2-e28febc9736f req-e25b00d7-2098-4e18-8bd3-02408ebd3fad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056217 Feb 17 03:29:01.121657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 213/435] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:29:01.128271 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d02a4ba7-7ed5-46ab-a3e6-75626d519c88 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:01.129785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d02a4ba7-7ed5-46ab-a3e6-75626d519c88 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:01.139788 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d02a4ba7-7ed5-46ab-a3e6-75626d519c88 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:01.140555 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d02a4ba7-7ed5-46ab-a3e6-75626d519c88 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:01.141573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d02a4ba7-7ed5-46ab-a3e6-75626d519c88 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:01.142269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d02a4ba7-7ed5-46ab-a3e6-75626d519c88 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:01.226691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1d9687e2-1051-41c4-bd38-01f78ee1e797 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:01.245901 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1d9687e2-1051-41c4-bd38-01f78ee1e797 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1508 microversion: 2.1 time: 0.304528 Feb 17 03:29:01.246635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 223/436] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:00 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:01.432604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d02a4ba7-7ed5-46ab-a3e6-75626d519c88 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 33332 microversion: 2.1 time: 0.309140 Feb 17 03:29:01.433958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 214/437] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:01 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 33332 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:01.514468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f6248600-8830-43a8-84c8-4b4f583a9f90 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:01.515141 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f6248600-8830-43a8-84c8-4b4f583a9f90 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:01.523925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f6248600-8830-43a8-84c8-4b4f583a9f90 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:01.524439 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f6248600-8830-43a8-84c8-4b4f583a9f90 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:01.525288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f6248600-8830-43a8-84c8-4b4f583a9f90 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:01.526298 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f6248600-8830-43a8-84c8-4b4f583a9f90 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:01.749615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f6248600-8830-43a8-84c8-4b4f583a9f90 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:01.762339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f6248600-8830-43a8-84c8-4b4f583a9f90 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.251788 Feb 17 03:29:01.763059 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 224/438] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:01 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:01.867263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2797eff7-1686-44fd-8600-22231dc4653f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:01.868051 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2797eff7-1686-44fd-8600-22231dc4653f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:01.877824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2797eff7-1686-44fd-8600-22231dc4653f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:01.878448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2797eff7-1686-44fd-8600-22231dc4653f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:01.879876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2797eff7-1686-44fd-8600-22231dc4653f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:01.880701 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2797eff7-1686-44fd-8600-22231dc4653f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.136023 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2797eff7-1686-44fd-8600-22231dc4653f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:02.148248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2797eff7-1686-44fd-8600-22231dc4653f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:02.149801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2797eff7-1686-44fd-8600-22231dc4653f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:02.151141 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2797eff7-1686-44fd-8600-22231dc4653f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.288778 Feb 17 03:29:02.151930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 215/439] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:01 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:02.265153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-aaf0007a-42ea-4f11-a967-ac62a7834992 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:02.265819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-aaf0007a-42ea-4f11-a967-ac62a7834992 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:02.273905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aaf0007a-42ea-4f11-a967-ac62a7834992 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.274405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aaf0007a-42ea-4f11-a967-ac62a7834992 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.275483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aaf0007a-42ea-4f11-a967-ac62a7834992 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.276191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aaf0007a-42ea-4f11-a967-ac62a7834992 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.447098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-56ec8f31-0008-46c8-b05e-33a1a7295128 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:02.448775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-56ec8f31-0008-46c8-b05e-33a1a7295128 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:02.482019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-56ec8f31-0008-46c8-b05e-33a1a7295128 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.483755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-56ec8f31-0008-46c8-b05e-33a1a7295128 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.495744 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-56ec8f31-0008-46c8-b05e-33a1a7295128 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.496705 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-56ec8f31-0008-46c8-b05e-33a1a7295128 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.566425 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-aaf0007a-42ea-4f11-a967-ac62a7834992 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:02.579847 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-aaf0007a-42ea-4f11-a967-ac62a7834992 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1508 microversion: 2.1 time: 0.318985 Feb 17 03:29:02.591843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 225/440] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:02 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:02.735736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-56ec8f31-0008-46c8-b05e-33a1a7295128 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 33511 microversion: 2.1 time: 0.292705 Feb 17 03:29:02.736621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 216/441] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:02 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 33511 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:29:02.780970 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-48f680d9-c6a5-4518-b79b-12f46e2e3a94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:02.781632 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-48f680d9-c6a5-4518-b79b-12f46e2e3a94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:02.790260 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-48f680d9-c6a5-4518-b79b-12f46e2e3a94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.790765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-48f680d9-c6a5-4518-b79b-12f46e2e3a94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.791659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-48f680d9-c6a5-4518-b79b-12f46e2e3a94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.792207 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-48f680d9-c6a5-4518-b79b-12f46e2e3a94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.020072 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-48f680d9-c6a5-4518-b79b-12f46e2e3a94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:03.031822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-48f680d9-c6a5-4518-b79b-12f46e2e3a94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.254612 Feb 17 03:29:03.033723 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 226/442] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:02 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:03.172556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8629a2c1-8bf3-4aee-be7d-7ea15f5fcd72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:03.173437 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8629a2c1-8bf3-4aee-be7d-7ea15f5fcd72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:03.184476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8629a2c1-8bf3-4aee-be7d-7ea15f5fcd72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.184980 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8629a2c1-8bf3-4aee-be7d-7ea15f5fcd72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.185819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8629a2c1-8bf3-4aee-be7d-7ea15f5fcd72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.186321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8629a2c1-8bf3-4aee-be7d-7ea15f5fcd72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.405611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8629a2c1-8bf3-4aee-be7d-7ea15f5fcd72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:03.416354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8629a2c1-8bf3-4aee-be7d-7ea15f5fcd72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:03.417864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8629a2c1-8bf3-4aee-be7d-7ea15f5fcd72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:03.419087 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8629a2c1-8bf3-4aee-be7d-7ea15f5fcd72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.251181 Feb 17 03:29:03.419871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 217/443] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:03 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:03.599847 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-40babf3d-1c4f-45bb-bd72-d520985f42d1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:03.600997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-40babf3d-1c4f-45bb-bd72-d520985f42d1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:03.611982 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40babf3d-1c4f-45bb-bd72-d520985f42d1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.612903 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40babf3d-1c4f-45bb-bd72-d520985f42d1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.613977 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40babf3d-1c4f-45bb-bd72-d520985f42d1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.614624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40babf3d-1c4f-45bb-bd72-d520985f42d1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.748361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2939de06-9873-4124-b975-738f114f1088 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:03.760141 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2939de06-9873-4124-b975-738f114f1088 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:03.760141 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2939de06-9873-4124-b975-738f114f1088 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.760141 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2939de06-9873-4124-b975-738f114f1088 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.760635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2939de06-9873-4124-b975-738f114f1088 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.761113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2939de06-9873-4124-b975-738f114f1088 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.844898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-40babf3d-1c4f-45bb-bd72-d520985f42d1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:03.854638 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-40babf3d-1c4f-45bb-bd72-d520985f42d1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1508 microversion: 2.1 time: 0.259582 Feb 17 03:29:03.861013 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 227/444] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:03 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:04.053784 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d8e2b1a1-4f40-4384-b2e6-3e002f4a637f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:04.056879 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d8e2b1a1-4f40-4384-b2e6-3e002f4a637f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:04.065238 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d8e2b1a1-4f40-4384-b2e6-3e002f4a637f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.065764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d8e2b1a1-4f40-4384-b2e6-3e002f4a637f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.066637 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d8e2b1a1-4f40-4384-b2e6-3e002f4a637f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.067140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d8e2b1a1-4f40-4384-b2e6-3e002f4a637f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.323944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d8e2b1a1-4f40-4384-b2e6-3e002f4a637f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:04.333147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d8e2b1a1-4f40-4384-b2e6-3e002f4a637f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.283393 Feb 17 03:29:04.333740 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 228/445] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:04 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:04.434527 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2939de06-9873-4124-b975-738f114f1088 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 33698 microversion: 2.1 time: 0.690116 Feb 17 03:29:04.435116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 218/446] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:03 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 33698 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:04.442721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cad4bac9-7086-4563-b88f-bee20481fc70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:04.443890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cad4bac9-7086-4563-b88f-bee20481fc70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:04.453580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cad4bac9-7086-4563-b88f-bee20481fc70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.454094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cad4bac9-7086-4563-b88f-bee20481fc70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.454979 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cad4bac9-7086-4563-b88f-bee20481fc70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.455591 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cad4bac9-7086-4563-b88f-bee20481fc70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.678621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cad4bac9-7086-4563-b88f-bee20481fc70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:04.688670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cad4bac9-7086-4563-b88f-bee20481fc70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:04.690215 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cad4bac9-7086-4563-b88f-bee20481fc70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:04.691444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cad4bac9-7086-4563-b88f-bee20481fc70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.256986 Feb 17 03:29:04.692068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 229/447] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:04 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:29:04.874720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-689ee8f1-f5e7-4a23-8c9d-e2d20341f307 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:04.875750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-689ee8f1-f5e7-4a23-8c9d-e2d20341f307 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:04.886752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-689ee8f1-f5e7-4a23-8c9d-e2d20341f307 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.887285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-689ee8f1-f5e7-4a23-8c9d-e2d20341f307 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.888240 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-689ee8f1-f5e7-4a23-8c9d-e2d20341f307 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.888728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-689ee8f1-f5e7-4a23-8c9d-e2d20341f307 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.170203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-689ee8f1-f5e7-4a23-8c9d-e2d20341f307 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:05.190628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-689ee8f1-f5e7-4a23-8c9d-e2d20341f307 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1514 microversion: 2.1 time: 0.321417 Feb 17 03:29:05.191665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 219/448] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:04 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:05.223822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-97887145-a968-4c45-800f-630d828a61be tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:05.225322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-97887145-a968-4c45-800f-630d828a61be tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:05.238411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-97887145-a968-4c45-800f-630d828a61be tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.239425 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-97887145-a968-4c45-800f-630d828a61be tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.242109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-97887145-a968-4c45-800f-630d828a61be tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.242619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-97887145-a968-4c45-800f-630d828a61be tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.352126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-18f0604f-3e18-4053-ba16-27838ebcf75f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:05.352781 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-18f0604f-3e18-4053-ba16-27838ebcf75f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:05.373380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-18f0604f-3e18-4053-ba16-27838ebcf75f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.373923 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-18f0604f-3e18-4053-ba16-27838ebcf75f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.374971 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-18f0604f-3e18-4053-ba16-27838ebcf75f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.375577 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-18f0604f-3e18-4053-ba16-27838ebcf75f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.378372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-97887145-a968-4c45-800f-630d828a61be tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Going to try to terminate instance {{(pid=98184) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:29:05.567124 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-97887145-a968-4c45-800f-630d828a61be tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "DELETE /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 204 len: 0 microversion: 2.1 time: 0.356312 Feb 17 03:29:05.568274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 230/449] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:29:05 2021] DELETE /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:29:05.575001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-73f2a764-8c4d-4241-b555-8c4684719a5c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:05.576405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-73f2a764-8c4d-4241-b555-8c4684719a5c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:05.586888 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73f2a764-8c4d-4241-b555-8c4684719a5c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.587523 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73f2a764-8c4d-4241-b555-8c4684719a5c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.590572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73f2a764-8c4d-4241-b555-8c4684719a5c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.591167 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73f2a764-8c4d-4241-b555-8c4684719a5c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.922803 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-73f2a764-8c4d-4241-b555-8c4684719a5c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 34063 microversion: 2.1 time: 0.352488 Feb 17 03:29:05.931427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 231/450] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:05 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 34063 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:05.934999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-18f0604f-3e18-4053-ba16-27838ebcf75f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:05.942586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8497b212-bdb9-492e-982b-8a621d94b6b7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:05.943637 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8497b212-bdb9-492e-982b-8a621d94b6b7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:05.948452 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-18f0604f-3e18-4053-ba16-27838ebcf75f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.601347 Feb 17 03:29:05.949205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 220/451] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:05 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:05.954936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8497b212-bdb9-492e-982b-8a621d94b6b7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.955172 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fd9f8e91-cb66-43ec-917a-469a7bc87a3b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:05.956047 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fd9f8e91-cb66-43ec-917a-469a7bc87a3b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:05.956824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8497b212-bdb9-492e-982b-8a621d94b6b7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.958340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8497b212-bdb9-492e-982b-8a621d94b6b7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.959192 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8497b212-bdb9-492e-982b-8a621d94b6b7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.965334 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd9f8e91-cb66-43ec-917a-469a7bc87a3b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.965840 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd9f8e91-cb66-43ec-917a-469a7bc87a3b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.966698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd9f8e91-cb66-43ec-917a-469a7bc87a3b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.967529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd9f8e91-cb66-43ec-917a-469a7bc87a3b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:06.435849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fd9f8e91-cb66-43ec-917a-469a7bc87a3b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:06.446912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8497b212-bdb9-492e-982b-8a621d94b6b7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:06.448653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fd9f8e91-cb66-43ec-917a-469a7bc87a3b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:06.453096 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fd9f8e91-cb66-43ec-917a-469a7bc87a3b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:06.454280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fd9f8e91-cb66-43ec-917a-469a7bc87a3b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.503544 Feb 17 03:29:06.455045 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 221/452] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:05 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:06.459247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8497b212-bdb9-492e-982b-8a621d94b6b7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1514 microversion: 2.1 time: 0.526044 Feb 17 03:29:06.463566 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 232/453] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:05 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1514 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:06.939430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-798958a5-315a-4315-b094-2a1e3bd5433d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:06.940567 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-798958a5-315a-4315-b094-2a1e3bd5433d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:06.948944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-798958a5-315a-4315-b094-2a1e3bd5433d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:06.949448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-798958a5-315a-4315-b094-2a1e3bd5433d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:06.950273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-798958a5-315a-4315-b094-2a1e3bd5433d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:06.950834 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-798958a5-315a-4315-b094-2a1e3bd5433d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:06.968051 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c96fd93e-23d8-472e-b2f9-1bbff5fdb1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:06.968710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c96fd93e-23d8-472e-b2f9-1bbff5fdb1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:06.977328 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c96fd93e-23d8-472e-b2f9-1bbff5fdb1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:06.977826 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c96fd93e-23d8-472e-b2f9-1bbff5fdb1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:06.978640 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c96fd93e-23d8-472e-b2f9-1bbff5fdb1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:06.979123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c96fd93e-23d8-472e-b2f9-1bbff5fdb1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.168977 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-798958a5-315a-4315-b094-2a1e3bd5433d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 34386 microversion: 2.1 time: 0.233213 Feb 17 03:29:07.169766 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 222/454] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:06 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 34386 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:07.271024 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c96fd93e-23d8-472e-b2f9-1bbff5fdb1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:07.280514 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c96fd93e-23d8-472e-b2f9-1bbff5fdb1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1317 microversion: 2.1 time: 0.316400 Feb 17 03:29:07.281175 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 233/455] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:06 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:07.475150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bc2f76bf-6733-4273-a0f5-9c29ddf3bc2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:07.476525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bc2f76bf-6733-4273-a0f5-9c29ddf3bc2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:07.477984 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-81dfce69-9b39-4e58-8999-9781eb057fc3 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:07.478801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-81dfce69-9b39-4e58-8999-9781eb057fc3 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:07.488203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-81dfce69-9b39-4e58-8999-9781eb057fc3 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:07.488854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-81dfce69-9b39-4e58-8999-9781eb057fc3 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.489706 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-81dfce69-9b39-4e58-8999-9781eb057fc3 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:07.490231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-81dfce69-9b39-4e58-8999-9781eb057fc3 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.494369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc2f76bf-6733-4273-a0f5-9c29ddf3bc2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:07.495313 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc2f76bf-6733-4273-a0f5-9c29ddf3bc2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.497533 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc2f76bf-6733-4273-a0f5-9c29ddf3bc2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:07.499885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc2f76bf-6733-4273-a0f5-9c29ddf3bc2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.884086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-81dfce69-9b39-4e58-8999-9781eb057fc3 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:07.885060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bc2f76bf-6733-4273-a0f5-9c29ddf3bc2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:07.897353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bc2f76bf-6733-4273-a0f5-9c29ddf3bc2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:07.899383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bc2f76bf-6733-4273-a0f5-9c29ddf3bc2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:07.900791 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bc2f76bf-6733-4273-a0f5-9c29ddf3bc2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.430660 Feb 17 03:29:07.901541 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 223/456] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:07 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:07.907606 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d66ec191-8442-4da7-b172-cf46034aabf9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:07.908652 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d66ec191-8442-4da7-b172-cf46034aabf9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:07.910669 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-81dfce69-9b39-4e58-8999-9781eb057fc3 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1514 microversion: 2.1 time: 0.436596 Feb 17 03:29:07.921989 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 234/457] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:07 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1514 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:07.937171 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d66ec191-8442-4da7-b172-cf46034aabf9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:07.937682 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d66ec191-8442-4da7-b172-cf46034aabf9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.938545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d66ec191-8442-4da7-b172-cf46034aabf9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:07.939032 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d66ec191-8442-4da7-b172-cf46034aabf9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.181991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bb7411c2-026a-4b94-b2f2-89cffeab485e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:08.183861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bb7411c2-026a-4b94-b2f2-89cffeab485e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:08.198784 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb7411c2-026a-4b94-b2f2-89cffeab485e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.199289 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb7411c2-026a-4b94-b2f2-89cffeab485e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.200168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb7411c2-026a-4b94-b2f2-89cffeab485e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.200841 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb7411c2-026a-4b94-b2f2-89cffeab485e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.251669 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d66ec191-8442-4da7-b172-cf46034aabf9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:08.261697 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d66ec191-8442-4da7-b172-cf46034aabf9 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1514 microversion: 2.1 time: 0.358849 Feb 17 03:29:08.262394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 224/458] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:07 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1514 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:08.280707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e56a25a8-0637-42fb-b53d-bb89a65df40b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d53943fa-053a-415a-8624-2edca6d7181c"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:08.281869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e56a25a8-0637-42fb-b53d-bb89a65df40b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:08.289876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e56a25a8-0637-42fb-b53d-bb89a65df40b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.290412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e56a25a8-0637-42fb-b53d-bb89a65df40b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.291246 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e56a25a8-0637-42fb-b53d-bb89a65df40b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.291815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e56a25a8-0637-42fb-b53d-bb89a65df40b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.392373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bb7411c2-026a-4b94-b2f2-89cffeab485e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 35002 microversion: 2.1 time: 0.214370 Feb 17 03:29:08.397369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 235/459] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:08 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 35002 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:08.399110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-54ef3481-6701-46d3-8697-c14828654f6d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:08.399893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-54ef3481-6701-46d3-8697-c14828654f6d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:08.408398 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-54ef3481-6701-46d3-8697-c14828654f6d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.408900 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-54ef3481-6701-46d3-8697-c14828654f6d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.409724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-54ef3481-6701-46d3-8697-c14828654f6d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.410213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-54ef3481-6701-46d3-8697-c14828654f6d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.624828 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-54ef3481-6701-46d3-8697-c14828654f6d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:08.634417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-54ef3481-6701-46d3-8697-c14828654f6d tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1507 microversion: 2.1 time: 0.240134 Feb 17 03:29:08.635018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 236/460] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:08 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:08.721300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e56a25a8-0637-42fb-b53d-bb89a65df40b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "POST /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444542 Feb 17 03:29:08.727387 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 225/461] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:29:08 2021] POST /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/os-volume_attachments => generated 194 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:29:08.928113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b1307077-ed92-4400-b3d2-fa6d6a3cd3db tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:08.928784 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b1307077-ed92-4400-b3d2-fa6d6a3cd3db tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:08.929708 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-795d0318-a615-4a31-8b0c-ffede876a483 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:08.930486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-795d0318-a615-4a31-8b0c-ffede876a483 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:08.957043 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-795d0318-a615-4a31-8b0c-ffede876a483 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.957659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-795d0318-a615-4a31-8b0c-ffede876a483 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.958627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1307077-ed92-4400-b3d2-fa6d6a3cd3db tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.959609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-795d0318-a615-4a31-8b0c-ffede876a483 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.961734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1307077-ed92-4400-b3d2-fa6d6a3cd3db tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.961868 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-795d0318-a615-4a31-8b0c-ffede876a483 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.962627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1307077-ed92-4400-b3d2-fa6d6a3cd3db tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.964517 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1307077-ed92-4400-b3d2-fa6d6a3cd3db tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:09.616711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-795d0318-a615-4a31-8b0c-ffede876a483 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:09.621182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b1307077-ed92-4400-b3d2-fa6d6a3cd3db tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:09.625647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-795d0318-a615-4a31-8b0c-ffede876a483 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1514 microversion: 2.1 time: 0.700451 Feb 17 03:29:09.626252 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 226/462] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:08 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1514 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:09.630422 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b1307077-ed92-4400-b3d2-fa6d6a3cd3db tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:09.631041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-931211d9-2f78-4464-a4e4-4ab7a5e24cba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:09.632007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b1307077-ed92-4400-b3d2-fa6d6a3cd3db tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:09.632211 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-931211d9-2f78-4464-a4e4-4ab7a5e24cba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:09.633181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b1307077-ed92-4400-b3d2-fa6d6a3cd3db tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.711440 Feb 17 03:29:09.633897 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 237/463] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:08 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:09.640678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-931211d9-2f78-4464-a4e4-4ab7a5e24cba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:09.641180 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-931211d9-2f78-4464-a4e4-4ab7a5e24cba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:09.642004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-931211d9-2f78-4464-a4e4-4ab7a5e24cba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:09.642486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-931211d9-2f78-4464-a4e4-4ab7a5e24cba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:10.644702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b71d666f-032a-4aac-9344-7efb352611eb tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:10.645353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b71d666f-032a-4aac-9344-7efb352611eb tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:10.653807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b71d666f-032a-4aac-9344-7efb352611eb tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:10.654305 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b71d666f-032a-4aac-9344-7efb352611eb tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:10.655122 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b71d666f-032a-4aac-9344-7efb352611eb tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:10.655628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b71d666f-032a-4aac-9344-7efb352611eb tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:10.857902 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b71d666f-032a-4aac-9344-7efb352611eb tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:10.867093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b71d666f-032a-4aac-9344-7efb352611eb tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1514 microversion: 2.1 time: 0.226515 Feb 17 03:29:10.867752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 238/464] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:10 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:10.872286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3a60088a-941b-4bd9-b966-2556159be660 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:10.872930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3a60088a-941b-4bd9-b966-2556159be660 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:10.880123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3a60088a-941b-4bd9-b966-2556159be660 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:10.880619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3a60088a-941b-4bd9-b966-2556159be660 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:10.882022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3a60088a-941b-4bd9-b966-2556159be660 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:10.882499 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3a60088a-941b-4bd9-b966-2556159be660 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:11.092497 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3a60088a-941b-4bd9-b966-2556159be660 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:11.102363 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3a60088a-941b-4bd9-b966-2556159be660 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:11.103934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3a60088a-941b-4bd9-b966-2556159be660 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:11.105095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3a60088a-941b-4bd9-b966-2556159be660 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.236368 Feb 17 03:29:11.105668 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 239/465] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:10 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:11.886282 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3262bb68-1e00-46fc-9bcc-91c5ddd59734 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:11.886993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3262bb68-1e00-46fc-9bcc-91c5ddd59734 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:11.895261 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3262bb68-1e00-46fc-9bcc-91c5ddd59734 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:11.895796 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3262bb68-1e00-46fc-9bcc-91c5ddd59734 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:11.897230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3262bb68-1e00-46fc-9bcc-91c5ddd59734 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:11.897716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3262bb68-1e00-46fc-9bcc-91c5ddd59734 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:12.105958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3262bb68-1e00-46fc-9bcc-91c5ddd59734 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:12.114861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3262bb68-1e00-46fc-9bcc-91c5ddd59734 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1514 microversion: 2.1 time: 0.232601 Feb 17 03:29:12.115464 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 240/466] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:11 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:12.126244 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-50f77c07-7216-4a9d-a34a-6361273a60c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:12.126244 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-50f77c07-7216-4a9d-a34a-6361273a60c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:12.133708 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50f77c07-7216-4a9d-a34a-6361273a60c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:12.134364 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50f77c07-7216-4a9d-a34a-6361273a60c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:12.135331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50f77c07-7216-4a9d-a34a-6361273a60c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:12.135842 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50f77c07-7216-4a9d-a34a-6361273a60c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:12.341546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-50f77c07-7216-4a9d-a34a-6361273a60c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:12.351016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-50f77c07-7216-4a9d-a34a-6361273a60c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:12.352641 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-50f77c07-7216-4a9d-a34a-6361273a60c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:12.353804 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-50f77c07-7216-4a9d-a34a-6361273a60c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.232864 Feb 17 03:29:12.354387 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 241/467] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:12 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:29:12.823339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-931211d9-2f78-4464-a4e4-4ab7a5e24cba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 37842 microversion: 2.1 time: 3.195625 Feb 17 03:29:12.824011 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 227/468] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:09 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 37842 bytes in 3197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:13.133168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0df4928f-0ce8-437a-b551-bd6f0549c4d7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:13.133922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0df4928f-0ce8-437a-b551-bd6f0549c4d7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:13.141795 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0df4928f-0ce8-437a-b551-bd6f0549c4d7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.142290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0df4928f-0ce8-437a-b551-bd6f0549c4d7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.143103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0df4928f-0ce8-437a-b551-bd6f0549c4d7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.143610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0df4928f-0ce8-437a-b551-bd6f0549c4d7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.376453 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3e010913-287a-413d-a261-1739e6ab2388 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:13.377255 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3e010913-287a-413d-a261-1739e6ab2388 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:13.388863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e010913-287a-413d-a261-1739e6ab2388 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.389292 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e010913-287a-413d-a261-1739e6ab2388 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.390179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e010913-287a-413d-a261-1739e6ab2388 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.390659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e010913-287a-413d-a261-1739e6ab2388 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.734458 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0df4928f-0ce8-437a-b551-bd6f0549c4d7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:13.750817 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0df4928f-0ce8-437a-b551-bd6f0549c4d7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1514 microversion: 2.1 time: 0.621701 Feb 17 03:29:13.756526 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 242/469] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:13 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1514 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:13.822544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3e010913-287a-413d-a261-1739e6ab2388 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:13.835997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5b3ac00f-5769-4eb7-9b7e-7229da7ee423 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:13.837222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5b3ac00f-5769-4eb7-9b7e-7229da7ee423 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:13.849213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3e010913-287a-413d-a261-1739e6ab2388 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:13.858284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3e010913-287a-413d-a261-1739e6ab2388 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:13.860084 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5b3ac00f-5769-4eb7-9b7e-7229da7ee423 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.861598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3e010913-287a-413d-a261-1739e6ab2388 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.489927 Feb 17 03:29:13.862344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5b3ac00f-5769-4eb7-9b7e-7229da7ee423 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.863959 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5b3ac00f-5769-4eb7-9b7e-7229da7ee423 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.865769 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5b3ac00f-5769-4eb7-9b7e-7229da7ee423 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.865998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 228/470] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:13 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:29:13.923199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b09e9061-c96f-4299-bdb6-bc735df77d94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "537f75c9-6f05-4af1-aeb5-bc92872c387c"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:13.924947 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b09e9061-c96f-4299-bdb6-bc735df77d94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:13.939336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b09e9061-c96f-4299-bdb6-bc735df77d94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.943326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b09e9061-c96f-4299-bdb6-bc735df77d94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.944647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b09e9061-c96f-4299-bdb6-bc735df77d94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.945339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b09e9061-c96f-4299-bdb6-bc735df77d94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:14.058118 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5b3ac00f-5769-4eb7-9b7e-7229da7ee423 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 38052 microversion: 2.1 time: 0.226586 Feb 17 03:29:14.059962 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 243/471] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:13 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 38052 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:29:14.505783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b09e9061-c96f-4299-bdb6-bc735df77d94 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "POST /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.586238 Feb 17 03:29:14.507682 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 229/472] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:29:13 2021] POST /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f/os-volume_attachments => generated 194 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:29:14.703606 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-2f93ef14-c735-4259-968d-64773e1b0545 req-988f18d1-fb48-4745-951b-426d66668a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa71048-be77-41c2-9f9c-ff388c8c3445", "name": "network-vif-deleted", "tag": "bbf1879d-8017-400d-8b73-01e598bd955f"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:14.705345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:14.705345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:29:14.727570 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-2f93ef14-c735-4259-968d-64773e1b0545 req-988f18d1-fb48-4745-951b-426d66668a33 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:14.728077 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-2f93ef14-c735-4259-968d-64773e1b0545 req-988f18d1-fb48-4745-951b-426d66668a33 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:14.774770 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-2f93ef14-c735-4259-968d-64773e1b0545 req-988f18d1-fb48-4745-951b-426d66668a33 service nova] Creating event network-vif-deleted:bbf1879d-8017-400d-8b73-01e598bd955f for instance caa71048-be77-41c2-9f9c-ff388c8c3445 on hv-cinder-75996 Feb 17 03:29:14.785194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-2f93ef14-c735-4259-968d-64773e1b0545 req-988f18d1-fb48-4745-951b-426d66668a33 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086773 Feb 17 03:29:14.788031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5d3f5868-a825-4989-9f78-e2b105737d92 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:14.789043 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5d3f5868-a825-4989-9f78-e2b105737d92 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:14.789772 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 244/473] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:29:14.808001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5d3f5868-a825-4989-9f78-e2b105737d92 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:14.808504 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5d3f5868-a825-4989-9f78-e2b105737d92 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:14.809357 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5d3f5868-a825-4989-9f78-e2b105737d92 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:14.809837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5d3f5868-a825-4989-9f78-e2b105737d92 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:14.889123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0e7e7193-ab98-48b0-8275-bb0b5c42f791 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:14.890177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0e7e7193-ab98-48b0-8275-bb0b5c42f791 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:14.899167 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0e7e7193-ab98-48b0-8275-bb0b5c42f791 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:14.899942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0e7e7193-ab98-48b0-8275-bb0b5c42f791 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:14.900952 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0e7e7193-ab98-48b0-8275-bb0b5c42f791 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:14.901585 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0e7e7193-ab98-48b0-8275-bb0b5c42f791 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:15.116277 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5d3f5868-a825-4989-9f78-e2b105737d92 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:15.136862 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5d3f5868-a825-4989-9f78-e2b105737d92 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 200 len: 1303 microversion: 2.1 time: 0.365586 Feb 17 03:29:15.155270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 230/474] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:14 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 1303 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:15.162579 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-36f87b81-61d7-4ebe-9288-40f8ae37ea2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:15.163983 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-36f87b81-61d7-4ebe-9288-40f8ae37ea2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:15.174411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-36f87b81-61d7-4ebe-9288-40f8ae37ea2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:15.174908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-36f87b81-61d7-4ebe-9288-40f8ae37ea2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:15.176159 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-36f87b81-61d7-4ebe-9288-40f8ae37ea2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:15.176645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-36f87b81-61d7-4ebe-9288-40f8ae37ea2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:15.246091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0e7e7193-ab98-48b0-8275-bb0b5c42f791 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:15.256113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0e7e7193-ab98-48b0-8275-bb0b5c42f791 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:15.260995 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0e7e7193-ab98-48b0-8275-bb0b5c42f791 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:15.263812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0e7e7193-ab98-48b0-8275-bb0b5c42f791 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.378996 Feb 17 03:29:15.264405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 245/475] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:14 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:15.344502 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-36f87b81-61d7-4ebe-9288-40f8ae37ea2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 38070 microversion: 2.1 time: 0.187241 Feb 17 03:29:15.345311 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 231/476] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:15 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 38070 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:16.157652 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7704eaa3-5c3e-40c3-b116-05f84bacbfc4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:16.158295 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7704eaa3-5c3e-40c3-b116-05f84bacbfc4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: caa71048-be77-41c2-9f9c-ff388c8c3445] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:16.169099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7704eaa3-5c3e-40c3-b116-05f84bacbfc4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.169754 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7704eaa3-5c3e-40c3-b116-05f84bacbfc4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.170998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7704eaa3-5c3e-40c3-b116-05f84bacbfc4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.171554 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7704eaa3-5c3e-40c3-b116-05f84bacbfc4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.236253 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-7704eaa3-5c3e-40c3-b116-05f84bacbfc4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] HTTP exception thrown: Instance caa71048-be77-41c2-9f9c-ff388c8c3445 could not be found. Feb 17 03:29:16.237224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7704eaa3-5c3e-40c3-b116-05f84bacbfc4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Returning 404 to user: Instance caa71048-be77-41c2-9f9c-ff388c8c3445 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:29:16.238265 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7704eaa3-5c3e-40c3-b116-05f84bacbfc4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445" status: 404 len: 111 microversion: 2.1 time: 0.084803 Feb 17 03:29:16.239013 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 246/477] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:16 2021] GET /compute/v2.1/servers/caa71048-be77-41c2-9f9c-ff388c8c3445 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:29:16.285357 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f798608f-0cd7-4554-b8a7-aa9d4ceafeb8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:16.286241 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f798608f-0cd7-4554-b8a7-aa9d4ceafeb8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:16.296103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f798608f-0cd7-4554-b8a7-aa9d4ceafeb8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.296754 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f798608f-0cd7-4554-b8a7-aa9d4ceafeb8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.297854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f798608f-0cd7-4554-b8a7-aa9d4ceafeb8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.298620 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f798608f-0cd7-4554-b8a7-aa9d4ceafeb8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.358095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-79354fea-3bbc-4a29-8d20-f986fe91c677 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:16.359126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-79354fea-3bbc-4a29-8d20-f986fe91c677 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:16.373893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-79354fea-3bbc-4a29-8d20-f986fe91c677 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.374542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-79354fea-3bbc-4a29-8d20-f986fe91c677 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.381925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-79354fea-3bbc-4a29-8d20-f986fe91c677 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.382424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-79354fea-3bbc-4a29-8d20-f986fe91c677 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.580058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f798608f-0cd7-4554-b8a7-aa9d4ceafeb8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:16.591683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f798608f-0cd7-4554-b8a7-aa9d4ceafeb8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:16.593217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f798608f-0cd7-4554-b8a7-aa9d4ceafeb8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:16.595562 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f798608f-0cd7-4554-b8a7-aa9d4ceafeb8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.314149 Feb 17 03:29:16.595562 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 232/478] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:16 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:16.625519 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-79354fea-3bbc-4a29-8d20-f986fe91c677 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 200 len: 38181 microversion: 2.1 time: 0.271242 Feb 17 03:29:16.627005 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 247/479] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:16 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 38181 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:16.639814 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f03909d7-6076-4b0a-92ef-037122dc9d32 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:16.641554 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f03909d7-6076-4b0a-92ef-037122dc9d32 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:16.662644 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f03909d7-6076-4b0a-92ef-037122dc9d32 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.664542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f03909d7-6076-4b0a-92ef-037122dc9d32 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.666010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f03909d7-6076-4b0a-92ef-037122dc9d32 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.668105 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f03909d7-6076-4b0a-92ef-037122dc9d32 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.766737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f03909d7-6076-4b0a-92ef-037122dc9d32 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/ips" status: 200 len: 146 microversion: 2.1 time: 0.132663 Feb 17 03:29:16.767687 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 233/480] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Feb 17 03:29:16 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/ips => generated 146 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:29:17.626645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-de27fc7f-24d3-4fd8-aad3-a62971af4e6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:17.627656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-de27fc7f-24d3-4fd8-aad3-a62971af4e6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:17.636711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-de27fc7f-24d3-4fd8-aad3-a62971af4e6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:17.637348 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-de27fc7f-24d3-4fd8-aad3-a62971af4e6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:17.638375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-de27fc7f-24d3-4fd8-aad3-a62971af4e6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:17.638948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-de27fc7f-24d3-4fd8-aad3-a62971af4e6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:17.859397 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-de27fc7f-24d3-4fd8-aad3-a62971af4e6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:17.869221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-de27fc7f-24d3-4fd8-aad3-a62971af4e6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:17.870931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-de27fc7f-24d3-4fd8-aad3-a62971af4e6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:17.872611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-de27fc7f-24d3-4fd8-aad3-a62971af4e6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.261529 Feb 17 03:29:17.873380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 248/481] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:17 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:18.893184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5f1577df-8c2a-4bb4-b08f-96c5cd30bf95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:18.893775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5f1577df-8c2a-4bb4-b08f-96c5cd30bf95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:18.902063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5f1577df-8c2a-4bb4-b08f-96c5cd30bf95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:18.902553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5f1577df-8c2a-4bb4-b08f-96c5cd30bf95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:18.903364 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5f1577df-8c2a-4bb4-b08f-96c5cd30bf95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:18.903872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5f1577df-8c2a-4bb4-b08f-96c5cd30bf95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:19.120854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5f1577df-8c2a-4bb4-b08f-96c5cd30bf95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:19.130173 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5f1577df-8c2a-4bb4-b08f-96c5cd30bf95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:19.131755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5f1577df-8c2a-4bb4-b08f-96c5cd30bf95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:19.132970 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5f1577df-8c2a-4bb4-b08f-96c5cd30bf95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.243815 Feb 17 03:29:19.133649 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 234/482] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:18 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:20.152827 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fa9cec31-9117-4eb9-8749-9570dcacbcab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:20.153526 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fa9cec31-9117-4eb9-8749-9570dcacbcab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:20.162952 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fa9cec31-9117-4eb9-8749-9570dcacbcab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:20.163447 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fa9cec31-9117-4eb9-8749-9570dcacbcab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:20.164290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fa9cec31-9117-4eb9-8749-9570dcacbcab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:20.164772 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fa9cec31-9117-4eb9-8749-9570dcacbcab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:20.375698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fa9cec31-9117-4eb9-8749-9570dcacbcab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:20.384939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fa9cec31-9117-4eb9-8749-9570dcacbcab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:20.386479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fa9cec31-9117-4eb9-8749-9570dcacbcab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:20.387670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fa9cec31-9117-4eb9-8749-9570dcacbcab tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.238792 Feb 17 03:29:20.388250 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 249/483] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:20 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:21.407069 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9c8bdd50-2333-4d49-ada5-5ce5b29c094e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:21.407975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9c8bdd50-2333-4d49-ada5-5ce5b29c094e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:21.422116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9c8bdd50-2333-4d49-ada5-5ce5b29c094e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:21.422607 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9c8bdd50-2333-4d49-ada5-5ce5b29c094e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:21.423430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9c8bdd50-2333-4d49-ada5-5ce5b29c094e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:21.423969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9c8bdd50-2333-4d49-ada5-5ce5b29c094e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:21.637144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9c8bdd50-2333-4d49-ada5-5ce5b29c094e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:21.646368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9c8bdd50-2333-4d49-ada5-5ce5b29c094e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:21.647927 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9c8bdd50-2333-4d49-ada5-5ce5b29c094e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:21.649073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9c8bdd50-2333-4d49-ada5-5ce5b29c094e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.246116 Feb 17 03:29:21.649656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 235/484] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:21 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:22.168642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e6c8ddad-3298-4589-9791-4c94e07d57cf tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:22.169702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e6c8ddad-3298-4589-9791-4c94e07d57cf tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:22.187833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e6c8ddad-3298-4589-9791-4c94e07d57cf tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:22.191594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e6c8ddad-3298-4589-9791-4c94e07d57cf tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:22.191594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e6c8ddad-3298-4589-9791-4c94e07d57cf tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:22.191594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e6c8ddad-3298-4589-9791-4c94e07d57cf tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:22.314414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-e6c8ddad-3298-4589-9791-4c94e07d57cf tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lazy-loading 'flavor' on Instance uuid 6ec09d11-1456-48e6-9b4a-cbb0c7775f78 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:29:22.672940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d90001c5-fdca-4869-879e-da6601360047 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:22.673514 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d90001c5-fdca-4869-879e-da6601360047 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:22.681575 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d90001c5-fdca-4869-879e-da6601360047 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:22.682075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d90001c5-fdca-4869-879e-da6601360047 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:22.682912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d90001c5-fdca-4869-879e-da6601360047 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:22.683400 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d90001c5-fdca-4869-879e-da6601360047 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:22.708301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e6c8ddad-3298-4589-9791-4c94e07d57cf tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "POST /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/action" status: 200 len: 32 microversion: 2.1 time: 0.543598 Feb 17 03:29:22.709557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 250/485] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:22 2021] POST /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/action => generated 32 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:29:22.715345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-414354d3-8785-4bd4-a075-369ea5ef2f3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38a3d119-4436-4877-b95a-c9cc74e5578d"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:22.716793 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-414354d3-8785-4bd4-a075-369ea5ef2f3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:22.725386 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-414354d3-8785-4bd4-a075-369ea5ef2f3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:22.725885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-414354d3-8785-4bd4-a075-369ea5ef2f3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:22.726716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-414354d3-8785-4bd4-a075-369ea5ef2f3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:22.727198 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-414354d3-8785-4bd4-a075-369ea5ef2f3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:22.915798 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d90001c5-fdca-4869-879e-da6601360047 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:22.926217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d90001c5-fdca-4869-879e-da6601360047 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:22.928287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d90001c5-fdca-4869-879e-da6601360047 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:22.929466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d90001c5-fdca-4869-879e-da6601360047 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1743 microversion: 2.20 time: 0.260695 Feb 17 03:29:22.930036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 236/486] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:22 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:22.934774 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-783f363e-87a4-499f-819d-8f40db9fe85f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:22.935424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-783f363e-87a4-499f-819d-8f40db9fe85f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:22.943571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-783f363e-87a4-499f-819d-8f40db9fe85f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:22.944079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-783f363e-87a4-499f-819d-8f40db9fe85f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:22.944905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-783f363e-87a4-499f-819d-8f40db9fe85f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:22.945389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-783f363e-87a4-499f-819d-8f40db9fe85f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:23.253451 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-783f363e-87a4-499f-819d-8f40db9fe85f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:23.264120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-783f363e-87a4-499f-819d-8f40db9fe85f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.332639 Feb 17 03:29:23.264790 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 237/487] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:22 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:23.401239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-414354d3-8785-4bd4-a075-369ea5ef2f3d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690010 Feb 17 03:29:23.401903 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 251/488] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:29:22 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:29:23.949922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a23d9465-414b-4239-bde4-fae0538cabec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:23.950852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a23d9465-414b-4239-bde4-fae0538cabec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:23.959351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a23d9465-414b-4239-bde4-fae0538cabec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:23.959883 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a23d9465-414b-4239-bde4-fae0538cabec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:23.960777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a23d9465-414b-4239-bde4-fae0538cabec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:23.961268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a23d9465-414b-4239-bde4-fae0538cabec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:24.250297 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a23d9465-414b-4239-bde4-fae0538cabec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:24.261813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a23d9465-414b-4239-bde4-fae0538cabec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:24.263726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a23d9465-414b-4239-bde4-fae0538cabec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:24.267316 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a23d9465-414b-4239-bde4-fae0538cabec tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1743 microversion: 2.20 time: 0.319258 Feb 17 03:29:24.267975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 238/489] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:23 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1743 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:24.284150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-19e186a8-2531-4fd0-b6f8-e3ade7068793 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:24.284858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-19e186a8-2531-4fd0-b6f8-e3ade7068793 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:24.293452 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19e186a8-2531-4fd0-b6f8-e3ade7068793 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:24.293961 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19e186a8-2531-4fd0-b6f8-e3ade7068793 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:24.294798 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19e186a8-2531-4fd0-b6f8-e3ade7068793 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:24.295292 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19e186a8-2531-4fd0-b6f8-e3ade7068793 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:24.508359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-19e186a8-2531-4fd0-b6f8-e3ade7068793 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:24.517671 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-19e186a8-2531-4fd0-b6f8-e3ade7068793 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.238784 Feb 17 03:29:24.518266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 252/490] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:24 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:25.287616 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-953ebc44-3006-48eb-b1a3-040ecaa55e85 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:25.288378 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-953ebc44-3006-48eb-b1a3-040ecaa55e85 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:25.296734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-953ebc44-3006-48eb-b1a3-040ecaa55e85 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:25.297411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-953ebc44-3006-48eb-b1a3-040ecaa55e85 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:25.298357 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-953ebc44-3006-48eb-b1a3-040ecaa55e85 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:25.299015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-953ebc44-3006-48eb-b1a3-040ecaa55e85 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:25.527880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-953ebc44-3006-48eb-b1a3-040ecaa55e85 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:25.537531 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-454e1d54-dc06-4790-b0d4-c07a5407b3c0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:25.538431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-454e1d54-dc06-4790-b0d4-c07a5407b3c0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:25.538878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-953ebc44-3006-48eb-b1a3-040ecaa55e85 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:25.540982 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-953ebc44-3006-48eb-b1a3-040ecaa55e85 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:25.543044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-953ebc44-3006-48eb-b1a3-040ecaa55e85 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1743 microversion: 2.20 time: 0.260705 Feb 17 03:29:25.555642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-454e1d54-dc06-4790-b0d4-c07a5407b3c0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:25.555642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-454e1d54-dc06-4790-b0d4-c07a5407b3c0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:25.555642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-454e1d54-dc06-4790-b0d4-c07a5407b3c0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:25.555642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-454e1d54-dc06-4790-b0d4-c07a5407b3c0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:25.556646 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 239/491] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:25 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1743 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:25.851783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-454e1d54-dc06-4790-b0d4-c07a5407b3c0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:25.861123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-454e1d54-dc06-4790-b0d4-c07a5407b3c0 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.328610 Feb 17 03:29:25.861871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 253/492] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:25 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:26.566350 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fc46585e-26be-407e-b881-1bfe87ac6286 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:26.567187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fc46585e-26be-407e-b881-1bfe87ac6286 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:26.576653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fc46585e-26be-407e-b881-1bfe87ac6286 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:26.577159 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fc46585e-26be-407e-b881-1bfe87ac6286 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:26.578009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fc46585e-26be-407e-b881-1bfe87ac6286 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:26.578491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fc46585e-26be-407e-b881-1bfe87ac6286 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:26.812361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fc46585e-26be-407e-b881-1bfe87ac6286 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:26.824126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fc46585e-26be-407e-b881-1bfe87ac6286 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:26.826231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fc46585e-26be-407e-b881-1bfe87ac6286 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:26.827667 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fc46585e-26be-407e-b881-1bfe87ac6286 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1743 microversion: 2.20 time: 0.268992 Feb 17 03:29:26.828398 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 240/493] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:26 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1743 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:26.879716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7e78a912-12eb-4afb-9db3-385913b0d2ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:26.880417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7e78a912-12eb-4afb-9db3-385913b0d2ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:26.890164 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7e78a912-12eb-4afb-9db3-385913b0d2ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:26.890951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7e78a912-12eb-4afb-9db3-385913b0d2ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:26.892038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7e78a912-12eb-4afb-9db3-385913b0d2ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:26.892688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7e78a912-12eb-4afb-9db3-385913b0d2ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:27.132655 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7e78a912-12eb-4afb-9db3-385913b0d2ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:27.143157 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7e78a912-12eb-4afb-9db3-385913b0d2ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.267669 Feb 17 03:29:27.143982 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 254/494] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:26 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:27.848210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3019058a-ab4d-4160-b015-b96a7b3c661f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:27.849003 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3019058a-ab4d-4160-b015-b96a7b3c661f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:27.857837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3019058a-ab4d-4160-b015-b96a7b3c661f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:27.858332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3019058a-ab4d-4160-b015-b96a7b3c661f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:27.859208 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3019058a-ab4d-4160-b015-b96a7b3c661f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:27.859752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3019058a-ab4d-4160-b015-b96a7b3c661f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:28.079721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3019058a-ab4d-4160-b015-b96a7b3c661f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:28.092028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3019058a-ab4d-4160-b015-b96a7b3c661f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:28.094786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3019058a-ab4d-4160-b015-b96a7b3c661f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:28.096344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3019058a-ab4d-4160-b015-b96a7b3c661f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1743 microversion: 2.20 time: 0.252705 Feb 17 03:29:28.098934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 241/495] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:27 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:28.160593 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7f98e1e2-f202-4a4f-94de-41fe5f30b6b3 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:28.161420 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7f98e1e2-f202-4a4f-94de-41fe5f30b6b3 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:28.170031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7f98e1e2-f202-4a4f-94de-41fe5f30b6b3 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:28.170536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7f98e1e2-f202-4a4f-94de-41fe5f30b6b3 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:28.171375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7f98e1e2-f202-4a4f-94de-41fe5f30b6b3 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:28.171893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7f98e1e2-f202-4a4f-94de-41fe5f30b6b3 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:28.394453 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7f98e1e2-f202-4a4f-94de-41fe5f30b6b3 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:28.404763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7f98e1e2-f202-4a4f-94de-41fe5f30b6b3 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.248065 Feb 17 03:29:28.405305 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 255/496] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:28 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:29.121659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-eab63c04-6e30-48a7-9551-ebe73b048ded tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:29.122232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-eab63c04-6e30-48a7-9551-ebe73b048ded tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:29.137613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eab63c04-6e30-48a7-9551-ebe73b048ded tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.137613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eab63c04-6e30-48a7-9551-ebe73b048ded tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.137613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eab63c04-6e30-48a7-9551-ebe73b048ded tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.137613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eab63c04-6e30-48a7-9551-ebe73b048ded tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.297777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-355928569", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "networks": [{"uuid": "c9e968ce-a441-4cd4-bf98-653e33e3e7b8"}]}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:29.387687 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-eab63c04-6e30-48a7-9551-ebe73b048ded tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:29.397095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-eab63c04-6e30-48a7-9551-ebe73b048ded tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:29.398762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-eab63c04-6e30-48a7-9551-ebe73b048ded tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:29.399987 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-eab63c04-6e30-48a7-9551-ebe73b048ded tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1738 microversion: 2.20 time: 0.286477 Feb 17 03:29:29.400579 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 242/497] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:29 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:29.421932 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0ac34f80-e7dd-40ac-81c4-cd8780a87e26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:29.422591 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0ac34f80-e7dd-40ac-81c4-cd8780a87e26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:29.430921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0ac34f80-e7dd-40ac-81c4-cd8780a87e26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.431362 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0ac34f80-e7dd-40ac-81c4-cd8780a87e26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.432217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0ac34f80-e7dd-40ac-81c4-cd8780a87e26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.432705 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0ac34f80-e7dd-40ac-81c4-cd8780a87e26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.915315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0ac34f80-e7dd-40ac-81c4-cd8780a87e26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:29.927064 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0ac34f80-e7dd-40ac-81c4-cd8780a87e26 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.508664 Feb 17 03:29:29.927790 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 243/498] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:29 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:30.420615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-35345889-e35b-4621-9d66-cff22e63124d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:30.421265 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-35345889-e35b-4621-9d66-cff22e63124d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:30.440881 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-35345889-e35b-4621-9d66-cff22e63124d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:30.441390 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-35345889-e35b-4621-9d66-cff22e63124d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:30.445101 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-35345889-e35b-4621-9d66-cff22e63124d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:30.445612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-35345889-e35b-4621-9d66-cff22e63124d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:30.738848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-35345889-e35b-4621-9d66-cff22e63124d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:30.757177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-35345889-e35b-4621-9d66-cff22e63124d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:30.759489 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-35345889-e35b-4621-9d66-cff22e63124d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:30.760289 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-35345889-e35b-4621-9d66-cff22e63124d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1738 microversion: 2.20 time: 0.344044 Feb 17 03:29:30.765965 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 244/499] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:30 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:29:30.946373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8620931e-708d-4a5d-b5a6-8c7c70bbc390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:30.947035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8620931e-708d-4a5d-b5a6-8c7c70bbc390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:30.955249 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8620931e-708d-4a5d-b5a6-8c7c70bbc390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:30.956085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8620931e-708d-4a5d-b5a6-8c7c70bbc390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:30.957089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8620931e-708d-4a5d-b5a6-8c7c70bbc390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:30.957875 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8620931e-708d-4a5d-b5a6-8c7c70bbc390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:31.212737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8620931e-708d-4a5d-b5a6-8c7c70bbc390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:31.224165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8620931e-708d-4a5d-b5a6-8c7c70bbc390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.282362 Feb 17 03:29:31.225671 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 245/500] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:30 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:31.788697 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-50632fc9-0aa0-4a94-adfc-46889b571090 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:31.789985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-50632fc9-0aa0-4a94-adfc-46889b571090 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:31.798864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50632fc9-0aa0-4a94-adfc-46889b571090 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:31.799610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50632fc9-0aa0-4a94-adfc-46889b571090 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:31.800611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50632fc9-0aa0-4a94-adfc-46889b571090 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:31.801242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50632fc9-0aa0-4a94-adfc-46889b571090 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:32.033573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-50632fc9-0aa0-4a94-adfc-46889b571090 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:32.046885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-50632fc9-0aa0-4a94-adfc-46889b571090 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:32.049067 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-50632fc9-0aa0-4a94-adfc-46889b571090 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:32.050418 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-50632fc9-0aa0-4a94-adfc-46889b571090 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1738 microversion: 2.20 time: 0.269193 Feb 17 03:29:32.053392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 246/501] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:31 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:29:32.058925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-554ea664-f65e-4cf5-82f0-137f75104d6a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:32.059734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-554ea664-f65e-4cf5-82f0-137f75104d6a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:32.069539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-554ea664-f65e-4cf5-82f0-137f75104d6a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:32.070320 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-554ea664-f65e-4cf5-82f0-137f75104d6a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:32.070918 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-554ea664-f65e-4cf5-82f0-137f75104d6a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:32.071332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-554ea664-f65e-4cf5-82f0-137f75104d6a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:32.300890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-554ea664-f65e-4cf5-82f0-137f75104d6a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lazy-loading 'services' on Instance uuid 08114034-f862-4a9a-a372-755e2b9a8b2f {{(pid=98183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:29:32.541973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-554ea664-f65e-4cf5-82f0-137f75104d6a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "DELETE /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f/os-volume_attachments/537f75c9-6f05-4af1-aeb5-bc92872c387c" status: 202 len: 0 microversion: 2.1 time: 0.487009 Feb 17 03:29:32.542745 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 247/502] 10.222.0.46 () {58 vars in 1406 bytes} [Wed Feb 17 03:29:32 2021] DELETE /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f/os-volume_attachments/537f75c9-6f05-4af1-aeb5-bc92872c387c => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:32.549435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c3d6a6ef-f273-40e6-ab7c-3ffe06c1bd4e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:32.550762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c3d6a6ef-f273-40e6-ab7c-3ffe06c1bd4e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:32.560717 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c3d6a6ef-f273-40e6-ab7c-3ffe06c1bd4e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:32.561302 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c3d6a6ef-f273-40e6-ab7c-3ffe06c1bd4e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:32.562283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c3d6a6ef-f273-40e6-ab7c-3ffe06c1bd4e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:32.562856 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c3d6a6ef-f273-40e6-ab7c-3ffe06c1bd4e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:32.869757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c3d6a6ef-f273-40e6-ab7c-3ffe06c1bd4e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:32.883446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c3d6a6ef-f273-40e6-ab7c-3ffe06c1bd4e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.339089 Feb 17 03:29:32.884229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 248/503] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:32 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:33.070325 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e0589c00-d731-4f0b-9f55-c661f4cad279 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:33.071042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e0589c00-d731-4f0b-9f55-c661f4cad279 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:33.078994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0589c00-d731-4f0b-9f55-c661f4cad279 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:33.079732 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0589c00-d731-4f0b-9f55-c661f4cad279 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:33.080734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0589c00-d731-4f0b-9f55-c661f4cad279 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:33.081315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0589c00-d731-4f0b-9f55-c661f4cad279 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:33.309571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e0589c00-d731-4f0b-9f55-c661f4cad279 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:33.320700 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e0589c00-d731-4f0b-9f55-c661f4cad279 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:33.322331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e0589c00-d731-4f0b-9f55-c661f4cad279 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:33.323533 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e0589c00-d731-4f0b-9f55-c661f4cad279 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1738 microversion: 2.20 time: 0.257451 Feb 17 03:29:33.324303 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 249/504] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:33 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:29:33.904781 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-03762144-603f-414a-993b-02b4a158410b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:33.905408 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-03762144-603f-414a-993b-02b4a158410b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:33.915057 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-03762144-603f-414a-993b-02b4a158410b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:33.915589 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-03762144-603f-414a-993b-02b4a158410b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:33.916409 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-03762144-603f-414a-993b-02b4a158410b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:33.917128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-03762144-603f-414a-993b-02b4a158410b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:34.159061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-03762144-603f-414a-993b-02b4a158410b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:34.174229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-03762144-603f-414a-993b-02b4a158410b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.273347 Feb 17 03:29:34.175128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 250/505] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:33 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:34.344003 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9828c3fd-5932-4387-a79b-5d36557f2d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:34.344653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9828c3fd-5932-4387-a79b-5d36557f2d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:34.355685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9828c3fd-5932-4387-a79b-5d36557f2d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:34.356183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9828c3fd-5932-4387-a79b-5d36557f2d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:34.357067 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9828c3fd-5932-4387-a79b-5d36557f2d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:34.357774 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9828c3fd-5932-4387-a79b-5d36557f2d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:34.590266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9828c3fd-5932-4387-a79b-5d36557f2d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:34.602676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9828c3fd-5932-4387-a79b-5d36557f2d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:34.604308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9828c3fd-5932-4387-a79b-5d36557f2d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:34.605493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9828c3fd-5932-4387-a79b-5d36557f2d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1738 microversion: 2.20 time: 0.265485 Feb 17 03:29:34.606074 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 251/506] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:34 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:29:35.194540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8ddec57e-7f0d-490d-a19e-23646f5ce297 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:35.195253 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8ddec57e-7f0d-490d-a19e-23646f5ce297 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:35.203793 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ddec57e-7f0d-490d-a19e-23646f5ce297 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:35.204133 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ddec57e-7f0d-490d-a19e-23646f5ce297 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:35.204978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ddec57e-7f0d-490d-a19e-23646f5ce297 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:35.205471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ddec57e-7f0d-490d-a19e-23646f5ce297 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:35.459724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8ddec57e-7f0d-490d-a19e-23646f5ce297 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:35.469906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8ddec57e-7f0d-490d-a19e-23646f5ce297 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.279365 Feb 17 03:29:35.476551 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 252/507] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:35 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:35.628739 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0d1e6901-91b3-4bb6-ba57-f1f3cd415b5b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:35.629626 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0d1e6901-91b3-4bb6-ba57-f1f3cd415b5b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:35.649950 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d1e6901-91b3-4bb6-ba57-f1f3cd415b5b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:35.650936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d1e6901-91b3-4bb6-ba57-f1f3cd415b5b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:35.652994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d1e6901-91b3-4bb6-ba57-f1f3cd415b5b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:35.654097 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d1e6901-91b3-4bb6-ba57-f1f3cd415b5b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:36.088794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0d1e6901-91b3-4bb6-ba57-f1f3cd415b5b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:36.102715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0d1e6901-91b3-4bb6-ba57-f1f3cd415b5b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:36.104125 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0d1e6901-91b3-4bb6-ba57-f1f3cd415b5b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:36.105331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0d1e6901-91b3-4bb6-ba57-f1f3cd415b5b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1738 microversion: 2.20 time: 0.480994 Feb 17 03:29:36.106532 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 253/508] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:35 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1738 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:36.490656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-848c1e39-37fc-49f5-8ab2-cc29adeec70d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:36.492106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-848c1e39-37fc-49f5-8ab2-cc29adeec70d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:36.503072 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-848c1e39-37fc-49f5-8ab2-cc29adeec70d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:36.503606 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-848c1e39-37fc-49f5-8ab2-cc29adeec70d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:36.504452 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-848c1e39-37fc-49f5-8ab2-cc29adeec70d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:36.504944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-848c1e39-37fc-49f5-8ab2-cc29adeec70d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:36.729938 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-848c1e39-37fc-49f5-8ab2-cc29adeec70d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:36.739477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-848c1e39-37fc-49f5-8ab2-cc29adeec70d tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.253650 Feb 17 03:29:36.740728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 254/509] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:36 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:37.125247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-713ffc8f-e0cd-4f3e-8d37-fbf7fcc46c90 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:37.126074 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-713ffc8f-e0cd-4f3e-8d37-fbf7fcc46c90 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:37.135377 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-713ffc8f-e0cd-4f3e-8d37-fbf7fcc46c90 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:37.136327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-713ffc8f-e0cd-4f3e-8d37-fbf7fcc46c90 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:37.144550 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-713ffc8f-e0cd-4f3e-8d37-fbf7fcc46c90 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:37.146620 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-713ffc8f-e0cd-4f3e-8d37-fbf7fcc46c90 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:37.488508 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-713ffc8f-e0cd-4f3e-8d37-fbf7fcc46c90 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:37.504522 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-713ffc8f-e0cd-4f3e-8d37-fbf7fcc46c90 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:37.506614 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-713ffc8f-e0cd-4f3e-8d37-fbf7fcc46c90 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:37.507923 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-713ffc8f-e0cd-4f3e-8d37-fbf7fcc46c90 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1738 microversion: 2.20 time: 0.386590 Feb 17 03:29:37.509789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 255/510] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:37 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1738 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:29:37.759425 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c801e368-2885-406d-be40-af1390a4075e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:37.761356 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c801e368-2885-406d-be40-af1390a4075e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:37.786633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c801e368-2885-406d-be40-af1390a4075e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:37.787462 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c801e368-2885-406d-be40-af1390a4075e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:37.788536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c801e368-2885-406d-be40-af1390a4075e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:37.789182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c801e368-2885-406d-be40-af1390a4075e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:38.246658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c801e368-2885-406d-be40-af1390a4075e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:38.260869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c801e368-2885-406d-be40-af1390a4075e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.505907 Feb 17 03:29:38.273138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 256/511] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:37 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:38.528224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6049886c-2e50-41aa-91ac-3824945eca4c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:38.530248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6049886c-2e50-41aa-91ac-3824945eca4c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:38.540657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6049886c-2e50-41aa-91ac-3824945eca4c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:38.541482 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6049886c-2e50-41aa-91ac-3824945eca4c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:38.542435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6049886c-2e50-41aa-91ac-3824945eca4c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:38.543019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6049886c-2e50-41aa-91ac-3824945eca4c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:38.779355 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6049886c-2e50-41aa-91ac-3824945eca4c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:38.789907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6049886c-2e50-41aa-91ac-3824945eca4c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:38.791473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6049886c-2e50-41aa-91ac-3824945eca4c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:38.792718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6049886c-2e50-41aa-91ac-3824945eca4c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1738 microversion: 2.20 time: 0.268466 Feb 17 03:29:38.793672 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 257/512] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:38 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:29:39.289027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1a342357-687b-468e-825e-14a49484d5bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:39.289932 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1a342357-687b-468e-825e-14a49484d5bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:39.298516 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a342357-687b-468e-825e-14a49484d5bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:39.299315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a342357-687b-468e-825e-14a49484d5bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:39.300439 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a342357-687b-468e-825e-14a49484d5bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:39.301078 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a342357-687b-468e-825e-14a49484d5bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:39.565309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1a342357-687b-468e-825e-14a49484d5bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:39.577730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1a342357-687b-468e-825e-14a49484d5bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.292629 Feb 17 03:29:39.578763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 258/513] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:39 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:39.583762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-56569df3-7c09-4509-a4a5-ead47ea11868 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:39.592663 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-56569df3-7c09-4509-a4a5-ead47ea11868 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:39.593221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-56569df3-7c09-4509-a4a5-ead47ea11868 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:39.656795 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-56569df3-7c09-4509-a4a5-ead47ea11868 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Going to try to stop instance {{(pid=98183) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 17 03:29:39.666613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] validate_networks() for [('c9e968ce-a441-4cd4-bf98-653e33e3e7b8', None, None, None)] {{(pid=98184) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:29:39.751204 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-56569df3-7c09-4509-a4a5-ead47ea11868 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 202 len: 0 microversion: 2.1 time: 0.170854 Feb 17 03:29:39.752019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 259/514] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:39 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:39.761047 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ae39126d-ebbd-48a9-b244-259ae8195abb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:39.761938 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ae39126d-ebbd-48a9-b244-259ae8195abb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:39.770205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ae39126d-ebbd-48a9-b244-259ae8195abb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:39.770697 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ae39126d-ebbd-48a9-b244-259ae8195abb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:39.771576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ae39126d-ebbd-48a9-b244-259ae8195abb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:39.772098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ae39126d-ebbd-48a9-b244-259ae8195abb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.164001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ae39126d-ebbd-48a9-b244-259ae8195abb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:40.173581 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ae39126d-ebbd-48a9-b244-259ae8195abb tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.417036 Feb 17 03:29:40.174189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 260/515] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:39 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:40.178873 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c872a611-5fcc-497f-b7c2-e11494c2e91b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:40.179577 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c872a611-5fcc-497f-b7c2-e11494c2e91b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:40.187105 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c872a611-5fcc-497f-b7c2-e11494c2e91b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:40.187633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c872a611-5fcc-497f-b7c2-e11494c2e91b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.188459 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c872a611-5fcc-497f-b7c2-e11494c2e91b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:40.188944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c872a611-5fcc-497f-b7c2-e11494c2e91b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.372688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Flavor limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:29:40.373157 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Image limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:29:40.373771 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Flavor pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:29:40.374224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Image pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:29:40.374680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:29:40.385765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:40.386266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.387331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:40.387875 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.407559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Getting quotas for project aa1d7bf87bab45169741a768823d447b. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:29:40.412154 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Getting quotas for user 84384593523349cd83241278c8e7de5a and project aa1d7bf87bab45169741a768823d447b. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:29:40.424224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Going to run 1 instances... {{(pid=98184) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:29:40.427193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:29:40.456571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c872a611-5fcc-497f-b7c2-e11494c2e91b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:40.467354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c872a611-5fcc-497f-b7c2-e11494c2e91b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:40.468977 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c872a611-5fcc-497f-b7c2-e11494c2e91b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:40.470187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c872a611-5fcc-497f-b7c2-e11494c2e91b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1738 microversion: 2.20 time: 0.294999 Feb 17 03:29:40.470774 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 261/516] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:40 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1738 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:40.484615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6a96c3b3-6df4-4c97-91ec-e01468c434c2 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.190766 Feb 17 03:29:40.485321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 256/517] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:29:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 11192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:29:40.495856 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-abe05500-4bb0-4acc-87ba-16aaccde95b4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:40.496518 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-abe05500-4bb0-4acc-87ba-16aaccde95b4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:40.574916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-abe05500-4bb0-4acc-87ba-16aaccde95b4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:40.583832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-abe05500-4bb0-4acc-87ba-16aaccde95b4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1218 microversion: 2.1 time: 0.091881 Feb 17 03:29:40.584442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 262/518] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:40 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:40.596376 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2f411c33-8fd2-4fff-b1d4-8cd046598f9f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:40.597307 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2f411c33-8fd2-4fff-b1d4-8cd046598f9f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:40.607527 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2f411c33-8fd2-4fff-b1d4-8cd046598f9f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:40.608173 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2f411c33-8fd2-4fff-b1d4-8cd046598f9f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.609106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2f411c33-8fd2-4fff-b1d4-8cd046598f9f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:40.609735 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2f411c33-8fd2-4fff-b1d4-8cd046598f9f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.834431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2f411c33-8fd2-4fff-b1d4-8cd046598f9f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:40.844009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2f411c33-8fd2-4fff-b1d4-8cd046598f9f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.251571 Feb 17 03:29:40.844613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 257/519] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:40 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:41.192658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d1a86540-e2fd-43e6-b316-a5834b517db7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:41.193315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d1a86540-e2fd-43e6-b316-a5834b517db7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:41.201684 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d1a86540-e2fd-43e6-b316-a5834b517db7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.202187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d1a86540-e2fd-43e6-b316-a5834b517db7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.203008 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d1a86540-e2fd-43e6-b316-a5834b517db7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.203492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d1a86540-e2fd-43e6-b316-a5834b517db7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.415895 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d1a86540-e2fd-43e6-b316-a5834b517db7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:41.430757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d1a86540-e2fd-43e6-b316-a5834b517db7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.241982 Feb 17 03:29:41.431390 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 263/520] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:41 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:41.490115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-45b7c05a-0408-4129-a24c-d93756af313d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:41.490775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-45b7c05a-0408-4129-a24c-d93756af313d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:41.498655 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45b7c05a-0408-4129-a24c-d93756af313d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.499161 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45b7c05a-0408-4129-a24c-d93756af313d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.500242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45b7c05a-0408-4129-a24c-d93756af313d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.500738 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45b7c05a-0408-4129-a24c-d93756af313d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.603901 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-20cf56e6-4c96-417e-b880-2b84248063cd tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:41.604559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-20cf56e6-4c96-417e-b880-2b84248063cd tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:41.612866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-20cf56e6-4c96-417e-b880-2b84248063cd tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.613337 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-20cf56e6-4c96-417e-b880-2b84248063cd tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.614168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-20cf56e6-4c96-417e-b880-2b84248063cd tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.614645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-20cf56e6-4c96-417e-b880-2b84248063cd tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.754063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-20cf56e6-4c96-417e-b880-2b84248063cd tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:41.764032 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-20cf56e6-4c96-417e-b880-2b84248063cd tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1222 microversion: 2.1 time: 0.164613 Feb 17 03:29:41.764279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-45b7c05a-0408-4129-a24c-d93756af313d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:41.764973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 264/521] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:41 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1222 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:41.775619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-45b7c05a-0408-4129-a24c-d93756af313d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:41.777167 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-45b7c05a-0408-4129-a24c-d93756af313d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:41.778341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-45b7c05a-0408-4129-a24c-d93756af313d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1738 microversion: 2.20 time: 0.292365 Feb 17 03:29:41.778916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 258/522] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:41 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:41.863171 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-836f408e-929e-4a50-8c5b-a1cce2af154a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:41.863870 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-836f408e-929e-4a50-8c5b-a1cce2af154a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:41.872213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-836f408e-929e-4a50-8c5b-a1cce2af154a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.872720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-836f408e-929e-4a50-8c5b-a1cce2af154a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.873545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-836f408e-929e-4a50-8c5b-a1cce2af154a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.874038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-836f408e-929e-4a50-8c5b-a1cce2af154a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:42.091300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-836f408e-929e-4a50-8c5b-a1cce2af154a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:42.101127 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-836f408e-929e-4a50-8c5b-a1cce2af154a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.241993 Feb 17 03:29:42.101793 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 265/523] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:41 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:42.449986 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8ede17b6-42d9-485b-8329-f2f03a5368d6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:42.450645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8ede17b6-42d9-485b-8329-f2f03a5368d6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:42.458816 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ede17b6-42d9-485b-8329-f2f03a5368d6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:42.459351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ede17b6-42d9-485b-8329-f2f03a5368d6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:42.460223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ede17b6-42d9-485b-8329-f2f03a5368d6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:42.460719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ede17b6-42d9-485b-8329-f2f03a5368d6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:42.689661 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8ede17b6-42d9-485b-8329-f2f03a5368d6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:42.698922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8ede17b6-42d9-485b-8329-f2f03a5368d6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.253549 Feb 17 03:29:42.699532 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 259/524] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:42 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:42.782189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8fa6638f-c866-424a-b773-18b8f7753d6c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:42.782957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8fa6638f-c866-424a-b773-18b8f7753d6c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:42.792000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fa6638f-c866-424a-b773-18b8f7753d6c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:42.792630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fa6638f-c866-424a-b773-18b8f7753d6c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:42.793557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fa6638f-c866-424a-b773-18b8f7753d6c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:42.794116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fa6638f-c866-424a-b773-18b8f7753d6c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:42.800002 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4f64053a-05d5-4325-86d4-54bf7772a033 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:42.800674 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4f64053a-05d5-4325-86d4-54bf7772a033 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:42.810212 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f64053a-05d5-4325-86d4-54bf7772a033 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:42.810714 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f64053a-05d5-4325-86d4-54bf7772a033 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:42.811801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f64053a-05d5-4325-86d4-54bf7772a033 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:42.812280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f64053a-05d5-4325-86d4-54bf7772a033 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:42.931328 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8fa6638f-c866-424a-b773-18b8f7753d6c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:42.942000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8fa6638f-c866-424a-b773-18b8f7753d6c tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1214 microversion: 2.1 time: 0.163626 Feb 17 03:29:42.943111 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 266/525] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:42 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:43.068730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4f64053a-05d5-4325-86d4-54bf7772a033 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:43.078822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4f64053a-05d5-4325-86d4-54bf7772a033 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:43.080853 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4f64053a-05d5-4325-86d4-54bf7772a033 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:43.083590 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4f64053a-05d5-4325-86d4-54bf7772a033 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1738 microversion: 2.20 time: 0.287059 Feb 17 03:29:43.084222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 260/526] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:42 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:43.119156 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5917bbd1-0553-42af-9cf5-5afe25d34ca6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:43.119848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5917bbd1-0553-42af-9cf5-5afe25d34ca6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:43.127648 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5917bbd1-0553-42af-9cf5-5afe25d34ca6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:43.128290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5917bbd1-0553-42af-9cf5-5afe25d34ca6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:43.129235 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5917bbd1-0553-42af-9cf5-5afe25d34ca6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:43.129728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5917bbd1-0553-42af-9cf5-5afe25d34ca6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:43.487287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5917bbd1-0553-42af-9cf5-5afe25d34ca6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:43.496686 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5917bbd1-0553-42af-9cf5-5afe25d34ca6 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.381547 Feb 17 03:29:43.497284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 267/527] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:43 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:43.717368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-844c49f9-ac16-497b-bd73-523edf3aaf19 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:43.718117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-844c49f9-ac16-497b-bd73-523edf3aaf19 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:43.726140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-844c49f9-ac16-497b-bd73-523edf3aaf19 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:43.726614 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-844c49f9-ac16-497b-bd73-523edf3aaf19 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:43.727431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-844c49f9-ac16-497b-bd73-523edf3aaf19 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:43.727940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-844c49f9-ac16-497b-bd73-523edf3aaf19 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:43.940031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-844c49f9-ac16-497b-bd73-523edf3aaf19 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:43.949973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-844c49f9-ac16-497b-bd73-523edf3aaf19 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.236627 Feb 17 03:29:43.950581 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 261/528] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:43 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:43.960474 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ef578de3-e19a-4e89-964d-5a7258b460ba tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:43.961133 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ef578de3-e19a-4e89-964d-5a7258b460ba tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:43.968865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef578de3-e19a-4e89-964d-5a7258b460ba tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:43.969502 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef578de3-e19a-4e89-964d-5a7258b460ba tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:43.970327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef578de3-e19a-4e89-964d-5a7258b460ba tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:43.970811 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef578de3-e19a-4e89-964d-5a7258b460ba tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.095346 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ef578de3-e19a-4e89-964d-5a7258b460ba tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:44.104580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0b56de25-3f9e-48aa-8056-facae6e11f16 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:44.105155 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ef578de3-e19a-4e89-964d-5a7258b460ba tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1270 microversion: 2.1 time: 0.148937 Feb 17 03:29:44.105273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0b56de25-3f9e-48aa-8056-facae6e11f16 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:44.105746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 268/529] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:43 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:44.112978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0b56de25-3f9e-48aa-8056-facae6e11f16 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:44.113479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0b56de25-3f9e-48aa-8056-facae6e11f16 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.114311 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0b56de25-3f9e-48aa-8056-facae6e11f16 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:44.114796 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0b56de25-3f9e-48aa-8056-facae6e11f16 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.395975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0b56de25-3f9e-48aa-8056-facae6e11f16 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:44.406006 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0b56de25-3f9e-48aa-8056-facae6e11f16 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:44.407587 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0b56de25-3f9e-48aa-8056-facae6e11f16 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:44.408757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0b56de25-3f9e-48aa-8056-facae6e11f16 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1720 microversion: 2.20 time: 0.308661 Feb 17 03:29:44.409346 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 262/530] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:44 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1720 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:29:44.515037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3c038310-dc85-4252-b22d-4762db28c08a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:44.515735 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3c038310-dc85-4252-b22d-4762db28c08a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:44.523911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c038310-dc85-4252-b22d-4762db28c08a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:44.524417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c038310-dc85-4252-b22d-4762db28c08a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.525244 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c038310-dc85-4252-b22d-4762db28c08a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:44.525735 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c038310-dc85-4252-b22d-4762db28c08a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.968274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e5204fb9-ee99-4842-9d46-26bcda405a91 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:44.969750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e5204fb9-ee99-4842-9d46-26bcda405a91 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:44.978536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e5204fb9-ee99-4842-9d46-26bcda405a91 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:44.979413 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e5204fb9-ee99-4842-9d46-26bcda405a91 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.980480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e5204fb9-ee99-4842-9d46-26bcda405a91 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:44.981165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e5204fb9-ee99-4842-9d46-26bcda405a91 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:45.178343 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3c038310-dc85-4252-b22d-4762db28c08a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:45.189840 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3c038310-dc85-4252-b22d-4762db28c08a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.678691 Feb 17 03:29:45.190565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 269/531] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:44 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:45.216400 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-50e359b2-20ab-446e-b550-2eb04ff7dcbf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:45.217242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-50e359b2-20ab-446e-b550-2eb04ff7dcbf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:45.237503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50e359b2-20ab-446e-b550-2eb04ff7dcbf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:45.238002 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50e359b2-20ab-446e-b550-2eb04ff7dcbf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:45.244799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50e359b2-20ab-446e-b550-2eb04ff7dcbf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:45.245300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-50e359b2-20ab-446e-b550-2eb04ff7dcbf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:45.525093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-50e359b2-20ab-446e-b550-2eb04ff7dcbf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:45.536184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-50e359b2-20ab-446e-b550-2eb04ff7dcbf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1276 microversion: 2.1 time: 0.344024 Feb 17 03:29:45.537094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 270/532] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:45 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1276 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:45.543063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1da2c3ce-75c5-4683-b73a-e87369d18f70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:45.544186 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1da2c3ce-75c5-4683-b73a-e87369d18f70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:45.553535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1da2c3ce-75c5-4683-b73a-e87369d18f70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:45.554438 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1da2c3ce-75c5-4683-b73a-e87369d18f70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:45.556243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1da2c3ce-75c5-4683-b73a-e87369d18f70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:45.557140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1da2c3ce-75c5-4683-b73a-e87369d18f70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:45.661858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e5204fb9-ee99-4842-9d46-26bcda405a91 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:45.675108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e5204fb9-ee99-4842-9d46-26bcda405a91 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.710725 Feb 17 03:29:45.675938 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 263/533] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:44 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:45.895157 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1da2c3ce-75c5-4683-b73a-e87369d18f70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:45.906747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1da2c3ce-75c5-4683-b73a-e87369d18f70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:45.908861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1da2c3ce-75c5-4683-b73a-e87369d18f70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:45.909679 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1da2c3ce-75c5-4683-b73a-e87369d18f70 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1720 microversion: 2.20 time: 0.371314 Feb 17 03:29:45.926089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 271/534] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:45 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1720 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:46.212139 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-608a155d-900b-49fe-b0f0-0ccd0f68a931 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:46.213424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-608a155d-900b-49fe-b0f0-0ccd0f68a931 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:46.222324 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-608a155d-900b-49fe-b0f0-0ccd0f68a931 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.223145 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-608a155d-900b-49fe-b0f0-0ccd0f68a931 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.224242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-608a155d-900b-49fe-b0f0-0ccd0f68a931 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.225224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-608a155d-900b-49fe-b0f0-0ccd0f68a931 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.445081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-608a155d-900b-49fe-b0f0-0ccd0f68a931 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:46.455538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-608a155d-900b-49fe-b0f0-0ccd0f68a931 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.247849 Feb 17 03:29:46.456162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 264/535] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:46 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:46.541586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d20390a2-949e-4f1b-b94d-7322e31f0640 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:46.542126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d20390a2-949e-4f1b-b94d-7322e31f0640 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:46.549909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d20390a2-949e-4f1b-b94d-7322e31f0640 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.550407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d20390a2-949e-4f1b-b94d-7322e31f0640 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.551219 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d20390a2-949e-4f1b-b94d-7322e31f0640 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.551731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d20390a2-949e-4f1b-b94d-7322e31f0640 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.554286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8844bc44-deae-499a-a26b-ef44f54f9965 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:46.554951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8844bc44-deae-499a-a26b-ef44f54f9965 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:46.562758 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8844bc44-deae-499a-a26b-ef44f54f9965 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.563257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8844bc44-deae-499a-a26b-ef44f54f9965 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.564145 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8844bc44-deae-499a-a26b-ef44f54f9965 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.564629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8844bc44-deae-499a-a26b-ef44f54f9965 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.617144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d20390a2-949e-4f1b-b94d-7322e31f0640 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Going to try to terminate instance {{(pid=98183) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:29:46.740979 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d20390a2-949e-4f1b-b94d-7322e31f0640 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "DELETE /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 204 len: 0 microversion: 2.1 time: 0.203111 Feb 17 03:29:46.745225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 272/536] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:29:46 2021] DELETE /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:29:46.749471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0314cea8-088a-4f20-8a63-f8c525abf2b9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:46.750826 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0314cea8-088a-4f20-8a63-f8c525abf2b9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:46.759262 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0314cea8-088a-4f20-8a63-f8c525abf2b9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.759880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0314cea8-088a-4f20-8a63-f8c525abf2b9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.760831 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0314cea8-088a-4f20-8a63-f8c525abf2b9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.761383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0314cea8-088a-4f20-8a63-f8c525abf2b9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.780733 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8844bc44-deae-499a-a26b-ef44f54f9965 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:46.789645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8844bc44-deae-499a-a26b-ef44f54f9965 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1318 microversion: 2.1 time: 0.239391 Feb 17 03:29:46.790560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 265/537] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:46 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:46.795238 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-71250161-b3ec-4fd1-89b8-529fcc05c808 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:46.795954 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-71250161-b3ec-4fd1-89b8-529fcc05c808 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:46.803776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71250161-b3ec-4fd1-89b8-529fcc05c808 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.804280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71250161-b3ec-4fd1-89b8-529fcc05c808 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.805653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71250161-b3ec-4fd1-89b8-529fcc05c808 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.806138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71250161-b3ec-4fd1-89b8-529fcc05c808 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.111327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0314cea8-088a-4f20-8a63-f8c525abf2b9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:47.120929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-71250161-b3ec-4fd1-89b8-529fcc05c808 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:47.121139 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0314cea8-088a-4f20-8a63-f8c525abf2b9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.377395 Feb 17 03:29:47.131940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 273/538] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:46 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:47.133810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-71250161-b3ec-4fd1-89b8-529fcc05c808 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1513 microversion: 2.1 time: 0.341052 Feb 17 03:29:47.135210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 266/539] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:46 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1513 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:47.139427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bc577676-708f-498a-b0dd-85408d7259e9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:47.140321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bc577676-708f-498a-b0dd-85408d7259e9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:47.152490 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc577676-708f-498a-b0dd-85408d7259e9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.153072 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc577676-708f-498a-b0dd-85408d7259e9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.154006 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc577676-708f-498a-b0dd-85408d7259e9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.154705 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc577676-708f-498a-b0dd-85408d7259e9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.390530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bc577676-708f-498a-b0dd-85408d7259e9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:47.407191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bc577676-708f-498a-b0dd-85408d7259e9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:47.408954 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bc577676-708f-498a-b0dd-85408d7259e9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:47.410267 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bc577676-708f-498a-b0dd-85408d7259e9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1720 microversion: 2.20 time: 0.276600 Feb 17 03:29:47.410933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 274/540] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:47 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1720 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:47.474997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-400999e8-fe51-4f98-a506-72dd089ea0da tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:47.475801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-400999e8-fe51-4f98-a506-72dd089ea0da tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:47.484476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-400999e8-fe51-4f98-a506-72dd089ea0da tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.485064 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-400999e8-fe51-4f98-a506-72dd089ea0da tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.485980 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-400999e8-fe51-4f98-a506-72dd089ea0da tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.486549 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-400999e8-fe51-4f98-a506-72dd089ea0da tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.700918 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-400999e8-fe51-4f98-a506-72dd089ea0da tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:47.710239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-400999e8-fe51-4f98-a506-72dd089ea0da tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1566 microversion: 2.1 time: 0.239602 Feb 17 03:29:47.711333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 267/541] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:47 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1566 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:47.807180 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c3d7d83b-d58f-4b2e-b573-8d997105cfaf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:47.808129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c3d7d83b-d58f-4b2e-b573-8d997105cfaf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:47.815662 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c3d7d83b-d58f-4b2e-b573-8d997105cfaf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.816158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c3d7d83b-d58f-4b2e-b573-8d997105cfaf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.816990 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c3d7d83b-d58f-4b2e-b573-8d997105cfaf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.817458 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c3d7d83b-d58f-4b2e-b573-8d997105cfaf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.944367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-40cc4ea7-cbc2-424c-86b8-4a93b84bbd4d req-8f11fcc9-4ad1-4e0d-a609-d6785dae3ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb66928f-13b6-4bf2-909c-6c9b985bf446", "tag": "82841018-3a77-4f6c-ba00-647e073193cc"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:47.946640 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:47.946640 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:29:47.955715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-40cc4ea7-cbc2-424c-86b8-4a93b84bbd4d req-8f11fcc9-4ad1-4e0d-a609-d6785dae3ea6 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.956326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-40cc4ea7-cbc2-424c-86b8-4a93b84bbd4d req-8f11fcc9-4ad1-4e0d-a609-d6785dae3ea6 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.974909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-40cc4ea7-cbc2-424c-86b8-4a93b84bbd4d req-8f11fcc9-4ad1-4e0d-a609-d6785dae3ea6 service nova] Creating event network-changed:82841018-3a77-4f6c-ba00-647e073193cc for instance eb66928f-13b6-4bf2-909c-6c9b985bf446 on hv-cinder-75996 Feb 17 03:29:47.980437 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-40cc4ea7-cbc2-424c-86b8-4a93b84bbd4d req-8f11fcc9-4ad1-4e0d-a609-d6785dae3ea6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039629 Feb 17 03:29:47.981353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 268/542] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:29:48.034209 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c3d7d83b-d58f-4b2e-b573-8d997105cfaf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:48.043102 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c3d7d83b-d58f-4b2e-b573-8d997105cfaf tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1318 microversion: 2.1 time: 0.239765 Feb 17 03:29:48.043727 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 275/543] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:47 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:48.139669 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-16d5ea91-2b5e-4556-902a-e5862e76474f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:48.140445 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-16d5ea91-2b5e-4556-902a-e5862e76474f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:48.150147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-16d5ea91-2b5e-4556-902a-e5862e76474f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.150591 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-16d5ea91-2b5e-4556-902a-e5862e76474f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.151437 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-16d5ea91-2b5e-4556-902a-e5862e76474f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.151955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-16d5ea91-2b5e-4556-902a-e5862e76474f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.154986 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-52809649-22b5-46ec-b5ab-9a8423fded63 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:48.155693 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-52809649-22b5-46ec-b5ab-9a8423fded63 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:48.163498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-52809649-22b5-46ec-b5ab-9a8423fded63 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.164125 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-52809649-22b5-46ec-b5ab-9a8423fded63 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.164942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-52809649-22b5-46ec-b5ab-9a8423fded63 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.165422 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-52809649-22b5-46ec-b5ab-9a8423fded63 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.498468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-16d5ea91-2b5e-4556-902a-e5862e76474f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:48.503734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-52809649-22b5-46ec-b5ab-9a8423fded63 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:48.510531 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-16d5ea91-2b5e-4556-902a-e5862e76474f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.375279 Feb 17 03:29:48.521294 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 269/544] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:48 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:48.521497 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-52809649-22b5-46ec-b5ab-9a8423fded63 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1513 microversion: 2.1 time: 0.364996 Feb 17 03:29:48.521601 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5750a6b6-b23f-4b74-a847-37e4985aaee4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:48.521601 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5750a6b6-b23f-4b74-a847-37e4985aaee4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:48.521998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 276/545] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:48 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1513 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:48.524880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5750a6b6-b23f-4b74-a847-37e4985aaee4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.525379 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5750a6b6-b23f-4b74-a847-37e4985aaee4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.526207 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5750a6b6-b23f-4b74-a847-37e4985aaee4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.526690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5750a6b6-b23f-4b74-a847-37e4985aaee4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.730149 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7ba57367-c986-42d8-a1fd-70aaf4ffb076 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:48.730820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7ba57367-c986-42d8-a1fd-70aaf4ffb076 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:48.739579 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7ba57367-c986-42d8-a1fd-70aaf4ffb076 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.740091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7ba57367-c986-42d8-a1fd-70aaf4ffb076 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.740947 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7ba57367-c986-42d8-a1fd-70aaf4ffb076 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.741443 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7ba57367-c986-42d8-a1fd-70aaf4ffb076 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.761118 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5750a6b6-b23f-4b74-a847-37e4985aaee4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:48.771310 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5750a6b6-b23f-4b74-a847-37e4985aaee4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:48.773173 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5750a6b6-b23f-4b74-a847-37e4985aaee4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:48.774411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5750a6b6-b23f-4b74-a847-37e4985aaee4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1720 microversion: 2.20 time: 0.261844 Feb 17 03:29:48.775003 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 270/546] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:48 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1720 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:48.954200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7ba57367-c986-42d8-a1fd-70aaf4ffb076 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:48.964179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7ba57367-c986-42d8-a1fd-70aaf4ffb076 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1546 microversion: 2.1 time: 0.238783 Feb 17 03:29:48.964971 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 277/547] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:48 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:48.983091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6ab54459-77b3-44f2-b99d-32c0e3f40c4c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:48.983695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6ab54459-77b3-44f2-b99d-32c0e3f40c4c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:48.991345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6ab54459-77b3-44f2-b99d-32c0e3f40c4c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.991905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6ab54459-77b3-44f2-b99d-32c0e3f40c4c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.992750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6ab54459-77b3-44f2-b99d-32c0e3f40c4c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.993235 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6ab54459-77b3-44f2-b99d-32c0e3f40c4c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:49.061280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d752b3da-b266-4952-8c6a-4550f481c0a9 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:49.062238 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d752b3da-b266-4952-8c6a-4550f481c0a9 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:49.071075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d752b3da-b266-4952-8c6a-4550f481c0a9 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:49.071600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d752b3da-b266-4952-8c6a-4550f481c0a9 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:49.072613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d752b3da-b266-4952-8c6a-4550f481c0a9 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:49.073201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d752b3da-b266-4952-8c6a-4550f481c0a9 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:49.191183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-6ab54459-77b3-44f2-b99d-32c0e3f40c4c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] HTTP exception thrown: Cannot 'detach_volume' instance 6ec09d11-1456-48e6-9b4a-cbb0c7775f78 while it is in vm_state rescued Feb 17 03:29:49.191863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6ab54459-77b3-44f2-b99d-32c0e3f40c4c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Returning 409 to user: Cannot 'detach_volume' instance 6ec09d11-1456-48e6-9b4a-cbb0c7775f78 while it is in vm_state rescued {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:29:49.192763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6ab54459-77b3-44f2-b99d-32c0e3f40c4c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/os-volume_attachments/d53943fa-053a-415a-8624-2edca6d7181c" status: 409 len: 152 microversion: 2.1 time: 0.214018 Feb 17 03:29:49.193515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 271/548] 10.222.0.46 () {58 vars in 1406 bytes} [Wed Feb 17 03:29:48 2021] DELETE /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/os-volume_attachments/d53943fa-053a-415a-8624-2edca6d7181c => generated 152 bytes in 215 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 17 03:29:49.202113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0a9cde38-ee25-49c3-a71a-a1ba65f925f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:49.202629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0a9cde38-ee25-49c3-a71a-a1ba65f925f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:49.211369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a9cde38-ee25-49c3-a71a-a1ba65f925f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:49.211936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a9cde38-ee25-49c3-a71a-a1ba65f925f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:49.212785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a9cde38-ee25-49c3-a71a-a1ba65f925f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:49.213472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a9cde38-ee25-49c3-a71a-a1ba65f925f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:49.311911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d752b3da-b266-4952-8c6a-4550f481c0a9 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:49.321465 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d752b3da-b266-4952-8c6a-4550f481c0a9 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1318 microversion: 2.1 time: 0.264336 Feb 17 03:29:49.323605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 278/549] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:49 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:49.369642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0a9cde38-ee25-49c3-a71a-a1ba65f925f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "POST /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/action" status: 202 len: 0 microversion: 2.1 time: 0.171027 Feb 17 03:29:49.373529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 272/550] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:49 2021] POST /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:29:49.379230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b75ec1b8-2a92-40ed-9ee6-894b2e761224 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:49.380006 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b75ec1b8-2a92-40ed-9ee6-894b2e761224 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:49.388621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b75ec1b8-2a92-40ed-9ee6-894b2e761224 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:49.389120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b75ec1b8-2a92-40ed-9ee6-894b2e761224 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:49.389953 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b75ec1b8-2a92-40ed-9ee6-894b2e761224 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:49.390580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b75ec1b8-2a92-40ed-9ee6-894b2e761224 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:49.531546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3b0da27e-3cec-454a-8c25-4a0b63f92010 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:49.531546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3b0da27e-3cec-454a-8c25-4a0b63f92010 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:49.545371 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b0da27e-3cec-454a-8c25-4a0b63f92010 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:49.545862 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b0da27e-3cec-454a-8c25-4a0b63f92010 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:49.546677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b0da27e-3cec-454a-8c25-4a0b63f92010 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:49.550366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b0da27e-3cec-454a-8c25-4a0b63f92010 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:49.837205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b75ec1b8-2a92-40ed-9ee6-894b2e761224 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:49.848172 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b75ec1b8-2a92-40ed-9ee6-894b2e761224 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1554 microversion: 2.1 time: 0.472954 Feb 17 03:29:49.856934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 279/551] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:49 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1554 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:49.856934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-44fa1eb4-ebfc-40f1-8991-39f8e982a014 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:49.856934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-44fa1eb4-ebfc-40f1-8991-39f8e982a014 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:49.862475 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-44fa1eb4-ebfc-40f1-8991-39f8e982a014 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:49.862975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-44fa1eb4-ebfc-40f1-8991-39f8e982a014 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:49.863828 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-44fa1eb4-ebfc-40f1-8991-39f8e982a014 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:49.864316 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-44fa1eb4-ebfc-40f1-8991-39f8e982a014 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:50.104377 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3b0da27e-3cec-454a-8c25-4a0b63f92010 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:50.122454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3b0da27e-3cec-454a-8c25-4a0b63f92010 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.596499 Feb 17 03:29:50.131209 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 273/552] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:49 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:50.131209 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c735b43c-1bf5-4960-8719-c7d4b0df7f8f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:50.131209 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c735b43c-1bf5-4960-8719-c7d4b0df7f8f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:50.137698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c735b43c-1bf5-4960-8719-c7d4b0df7f8f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:50.138311 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c735b43c-1bf5-4960-8719-c7d4b0df7f8f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:50.139139 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c735b43c-1bf5-4960-8719-c7d4b0df7f8f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:50.139682 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c735b43c-1bf5-4960-8719-c7d4b0df7f8f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:50.416403 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-44fa1eb4-ebfc-40f1-8991-39f8e982a014 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:50.430771 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-44fa1eb4-ebfc-40f1-8991-39f8e982a014 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1513 microversion: 2.1 time: 0.579663 Feb 17 03:29:50.431589 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 280/553] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:49 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1513 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:50.439151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2598aa45-0036-4599-aa08-ae231461af8f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:50.440088 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2598aa45-0036-4599-aa08-ae231461af8f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:50.450031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2598aa45-0036-4599-aa08-ae231461af8f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:50.450870 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2598aa45-0036-4599-aa08-ae231461af8f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:50.451988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2598aa45-0036-4599-aa08-ae231461af8f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:50.452651 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2598aa45-0036-4599-aa08-ae231461af8f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:50.982184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c735b43c-1bf5-4960-8719-c7d4b0df7f8f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:50.992021 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c735b43c-1bf5-4960-8719-c7d4b0df7f8f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:50.993729 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c735b43c-1bf5-4960-8719-c7d4b0df7f8f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:50.994992 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c735b43c-1bf5-4960-8719-c7d4b0df7f8f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1720 microversion: 2.20 time: 0.870858 Feb 17 03:29:50.995702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 274/554] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:50 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1720 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:51.000577 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-286580ea-0af9-4d3f-8988-2f21fc433177 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:51.001455 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-286580ea-0af9-4d3f-8988-2f21fc433177 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:51.010259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-286580ea-0af9-4d3f-8988-2f21fc433177 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:51.010765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-286580ea-0af9-4d3f-8988-2f21fc433177 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:51.011755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-286580ea-0af9-4d3f-8988-2f21fc433177 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:51.012317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-286580ea-0af9-4d3f-8988-2f21fc433177 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:51.093163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2598aa45-0036-4599-aa08-ae231461af8f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:51.102401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2598aa45-0036-4599-aa08-ae231461af8f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1318 microversion: 2.1 time: 0.669376 Feb 17 03:29:51.110146 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 281/555] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:50 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:51.141193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ed7f609b-104c-4f4d-9a97-197eb9b4104e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:51.141862 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ed7f609b-104c-4f4d-9a97-197eb9b4104e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:51.150378 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ed7f609b-104c-4f4d-9a97-197eb9b4104e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:51.150880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ed7f609b-104c-4f4d-9a97-197eb9b4104e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:51.151744 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ed7f609b-104c-4f4d-9a97-197eb9b4104e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:51.152246 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ed7f609b-104c-4f4d-9a97-197eb9b4104e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:51.319191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-286580ea-0af9-4d3f-8988-2f21fc433177 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:51.329670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-286580ea-0af9-4d3f-8988-2f21fc433177 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1554 microversion: 2.1 time: 0.332806 Feb 17 03:29:51.330343 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 275/556] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:50 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1554 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:51.449823 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8a271472-8ee6-4135-b670-ed7c9e37d344 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:51.450573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8a271472-8ee6-4135-b670-ed7c9e37d344 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:51.458991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8a271472-8ee6-4135-b670-ed7c9e37d344 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:51.459528 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8a271472-8ee6-4135-b670-ed7c9e37d344 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:51.460365 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8a271472-8ee6-4135-b670-ed7c9e37d344 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:51.460861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8a271472-8ee6-4135-b670-ed7c9e37d344 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:51.513879 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ed7f609b-104c-4f4d-9a97-197eb9b4104e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:51.529863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ed7f609b-104c-4f4d-9a97-197eb9b4104e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.392614 Feb 17 03:29:51.532542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 282/557] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:51 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:51.629970 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-8c4d1266-f987-486a-863a-b258af5ab5f6 req-e70797ea-ed0c-4cf8-bd4b-bfd39c37610e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89d14a3-493e-413a-918e-fd2de544e689", "name": "network-vif-unplugged", "status": "completed", "tag": "8e645981-866a-495c-83c8-d0e1206a99d1"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:51.636027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:51.636027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:29:51.645473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-8c4d1266-f987-486a-863a-b258af5ab5f6 req-e70797ea-ed0c-4cf8-bd4b-bfd39c37610e service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:51.646145 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-8c4d1266-f987-486a-863a-b258af5ab5f6 req-e70797ea-ed0c-4cf8-bd4b-bfd39c37610e service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:51.663810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.compute.server_external_events [req-8c4d1266-f987-486a-863a-b258af5ab5f6 req-e70797ea-ed0c-4cf8-bd4b-bfd39c37610e service nova] Unable to find a host for instance a89d14a3-493e-413a-918e-fd2de544e689. Dropping event network-vif-unplugged {{(pid=98183) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 17 03:29:51.665445 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-8c4d1266-f987-486a-863a-b258af5ab5f6 req-e70797ea-ed0c-4cf8-bd4b-bfd39c37610e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042273 Feb 17 03:29:51.666359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 283/558] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:51 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 17 03:29:52.014566 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c6471176-f147-4700-a3df-569a836493d0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:52.015332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c6471176-f147-4700-a3df-569a836493d0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:52.023846 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6471176-f147-4700-a3df-569a836493d0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:52.024394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6471176-f147-4700-a3df-569a836493d0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:52.025238 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6471176-f147-4700-a3df-569a836493d0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:52.025695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6471176-f147-4700-a3df-569a836493d0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:52.091067 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8a271472-8ee6-4135-b670-ed7c9e37d344 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:52.100461 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8a271472-8ee6-4135-b670-ed7c9e37d344 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1513 microversion: 2.1 time: 0.655311 Feb 17 03:29:52.100997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 276/559] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:51 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1513 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:52.121978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e9a41d4f-42ba-494a-a792-85a3e4ed4d05 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:52.122818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e9a41d4f-42ba-494a-a792-85a3e4ed4d05 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:52.130822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e9a41d4f-42ba-494a-a792-85a3e4ed4d05 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:52.131320 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e9a41d4f-42ba-494a-a792-85a3e4ed4d05 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:52.132177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e9a41d4f-42ba-494a-a792-85a3e4ed4d05 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:52.132753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e9a41d4f-42ba-494a-a792-85a3e4ed4d05 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:52.317332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c6471176-f147-4700-a3df-569a836493d0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:52.327086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c6471176-f147-4700-a3df-569a836493d0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:52.328708 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c6471176-f147-4700-a3df-569a836493d0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:52.329920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c6471176-f147-4700-a3df-569a836493d0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1663 microversion: 2.20 time: 0.319402 Feb 17 03:29:52.330500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 284/560] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:52 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1663 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:29:52.348403 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-01ab5918-6843-44e1-afce-88b1c3aa71a4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:52.349052 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-01ab5918-6843-44e1-afce-88b1c3aa71a4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:52.357054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-01ab5918-6843-44e1-afce-88b1c3aa71a4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:52.357485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-01ab5918-6843-44e1-afce-88b1c3aa71a4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:52.358300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-01ab5918-6843-44e1-afce-88b1c3aa71a4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:52.358775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-01ab5918-6843-44e1-afce-88b1c3aa71a4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:52.397665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e9a41d4f-42ba-494a-a792-85a3e4ed4d05 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:52.406985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e9a41d4f-42ba-494a-a792-85a3e4ed4d05 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1318 microversion: 2.1 time: 0.288828 Feb 17 03:29:52.407605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 277/561] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:52 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:52.412414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3e201bd6-c249-4458-abb5-7573e45fbfcf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9ef5e14-98c6-4653-80f9-fc4588bdcb37"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:52.413650 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3e201bd6-c249-4458-abb5-7573e45fbfcf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:52.421599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e201bd6-c249-4458-abb5-7573e45fbfcf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:52.422306 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e201bd6-c249-4458-abb5-7573e45fbfcf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:52.423145 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e201bd6-c249-4458-abb5-7573e45fbfcf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:52.423664 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e201bd6-c249-4458-abb5-7573e45fbfcf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:52.592087 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-01ab5918-6843-44e1-afce-88b1c3aa71a4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:52.603157 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-01ab5918-6843-44e1-afce-88b1c3aa71a4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1554 microversion: 2.1 time: 0.258849 Feb 17 03:29:52.604086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 285/562] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:52 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1554 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:52.608763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4b5b96e1-4805-4fe0-b185-a511d1b54db9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:52.609426 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4b5b96e1-4805-4fe0-b185-a511d1b54db9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:52.617757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4b5b96e1-4805-4fe0-b185-a511d1b54db9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:52.618279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4b5b96e1-4805-4fe0-b185-a511d1b54db9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:52.619269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4b5b96e1-4805-4fe0-b185-a511d1b54db9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:52.620125 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4b5b96e1-4805-4fe0-b185-a511d1b54db9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:52.930434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3e201bd6-c249-4458-abb5-7573e45fbfcf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.521143 Feb 17 03:29:52.931094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 278/563] 10.222.0.46 () {62 vars in 1354 bytes} [Wed Feb 17 03:29:52 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/os-volume_attachments => generated 188 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:53.046643 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-db14ee7c-6fd0-46c3-8ebe-bd147ae961b3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:53.047874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-db14ee7c-6fd0-46c3-8ebe-bd147ae961b3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:53.056422 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db14ee7c-6fd0-46c3-8ebe-bd147ae961b3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.057261 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db14ee7c-6fd0-46c3-8ebe-bd147ae961b3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.057756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db14ee7c-6fd0-46c3-8ebe-bd147ae961b3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.058242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db14ee7c-6fd0-46c3-8ebe-bd147ae961b3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.089392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4b5b96e1-4805-4fe0-b185-a511d1b54db9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:53.100060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4b5b96e1-4805-4fe0-b185-a511d1b54db9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.495006 Feb 17 03:29:53.100675 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 286/564] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:52 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:53.118725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-725fcb17-dfeb-434f-bba1-e710a9995ccd tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:53.119393 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-725fcb17-dfeb-434f-bba1-e710a9995ccd tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:53.127698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-725fcb17-dfeb-434f-bba1-e710a9995ccd tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.128177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-725fcb17-dfeb-434f-bba1-e710a9995ccd tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.129271 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-725fcb17-dfeb-434f-bba1-e710a9995ccd tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.129836 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-725fcb17-dfeb-434f-bba1-e710a9995ccd tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.224789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-db14ee7c-6fd0-46c3-8ebe-bd147ae961b3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action" status: 202 len: 0 microversion: 2.20 time: 0.182000 Feb 17 03:29:53.227142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 279/565] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:53 2021] POST /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 17 03:29:53.234985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ee4fd0ef-5651-4ecf-8a09-956a6eedf52b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:53.236007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ee4fd0ef-5651-4ecf-8a09-956a6eedf52b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:53.246962 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ee4fd0ef-5651-4ecf-8a09-956a6eedf52b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.247851 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ee4fd0ef-5651-4ecf-8a09-956a6eedf52b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.248511 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ee4fd0ef-5651-4ecf-8a09-956a6eedf52b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.249079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ee4fd0ef-5651-4ecf-8a09-956a6eedf52b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.682156 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-725fcb17-dfeb-434f-bba1-e710a9995ccd tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:53.694987 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-725fcb17-dfeb-434f-bba1-e710a9995ccd tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1513 microversion: 2.1 time: 0.580581 Feb 17 03:29:53.696781 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 287/566] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:53 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1513 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:53.704247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3e2936b5-123e-4fcc-ba52-4dabe8263d37 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:53.705309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3e2936b5-123e-4fcc-ba52-4dabe8263d37 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:53.718162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e2936b5-123e-4fcc-ba52-4dabe8263d37 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.719464 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e2936b5-123e-4fcc-ba52-4dabe8263d37 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.721195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e2936b5-123e-4fcc-ba52-4dabe8263d37 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.721876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e2936b5-123e-4fcc-ba52-4dabe8263d37 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.771638 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ee4fd0ef-5651-4ecf-8a09-956a6eedf52b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:53.804279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ee4fd0ef-5651-4ecf-8a09-956a6eedf52b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:53.806110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ee4fd0ef-5651-4ecf-8a09-956a6eedf52b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:53.807561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ee4fd0ef-5651-4ecf-8a09-956a6eedf52b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1749 microversion: 2.20 time: 0.576454 Feb 17 03:29:53.810418 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 280/567] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:53 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1749 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:53.817320 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-578940db-f454-482c-91f9-871c0093d6cb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:53.827022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-578940db-f454-482c-91f9-871c0093d6cb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:53.845340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-578940db-f454-482c-91f9-871c0093d6cb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.845947 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-578940db-f454-482c-91f9-871c0093d6cb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.847553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-578940db-f454-482c-91f9-871c0093d6cb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.848218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-578940db-f454-482c-91f9-871c0093d6cb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.067279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3e2936b5-123e-4fcc-ba52-4dabe8263d37 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:54.075933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3e2936b5-123e-4fcc-ba52-4dabe8263d37 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1318 microversion: 2.1 time: 0.376488 Feb 17 03:29:54.086073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 288/568] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:53 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:54.086073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-4a030d85-d072-4a59-b932-1bb2295f4a07 req-a6f49233-ca38-4c36-9f58-7d5d7f249659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08114034-f862-4a9a-a372-755e2b9a8b2f", "name": "network-vif-unplugged", "status": "completed", "tag": "62f4a7fe-8e9b-45c2-a79a-667070ef1221"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:54.086073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:54.086073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:29:54.092341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-4a030d85-d072-4a59-b932-1bb2295f4a07 req-a6f49233-ca38-4c36-9f58-7d5d7f249659 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.092811 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-4a030d85-d072-4a59-b932-1bb2295f4a07 req-a6f49233-ca38-4c36-9f58-7d5d7f249659 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.111309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-4a030d85-d072-4a59-b932-1bb2295f4a07 req-a6f49233-ca38-4c36-9f58-7d5d7f249659 service nova] Creating event network-vif-unplugged:62f4a7fe-8e9b-45c2-a79a-667070ef1221 for instance 08114034-f862-4a9a-a372-755e2b9a8b2f on hv-cinder-75996 Feb 17 03:29:54.116323 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-4a030d85-d072-4a59-b932-1bb2295f4a07 req-a6f49233-ca38-4c36-9f58-7d5d7f249659 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038411 Feb 17 03:29:54.117761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 289/569] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:54 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:29:54.123653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-6fd5f84b-8fd9-40a1-8a90-8ca6ceb87ec1 req-d6f662ed-61e2-4ea0-af4c-8ca4bd225fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08114034-f862-4a9a-a372-755e2b9a8b2f", "name": "network-vif-deleted", "tag": "62f4a7fe-8e9b-45c2-a79a-667070ef1221"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:54.125309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:54.125309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:29:54.134344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-6fd5f84b-8fd9-40a1-8a90-8ca6ceb87ec1 req-d6f662ed-61e2-4ea0-af4c-8ca4bd225fb4 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.134833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-6fd5f84b-8fd9-40a1-8a90-8ca6ceb87ec1 req-d6f662ed-61e2-4ea0-af4c-8ca4bd225fb4 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.138237 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-578940db-f454-482c-91f9-871c0093d6cb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:54.147838 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-578940db-f454-482c-91f9-871c0093d6cb tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1554 microversion: 2.1 time: 0.334108 Feb 17 03:29:54.148468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 281/570] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:53 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1554 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:54.151975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-6fd5f84b-8fd9-40a1-8a90-8ca6ceb87ec1 req-d6f662ed-61e2-4ea0-af4c-8ca4bd225fb4 service nova] Creating event network-vif-deleted:62f4a7fe-8e9b-45c2-a79a-667070ef1221 for instance 08114034-f862-4a9a-a372-755e2b9a8b2f on hv-cinder-75996 Feb 17 03:29:54.153220 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6a415c23-f385-4b3f-a2db-16b2d56a6a38 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:54.154060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6a415c23-f385-4b3f-a2db-16b2d56a6a38 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:54.156746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-6fd5f84b-8fd9-40a1-8a90-8ca6ceb87ec1 req-d6f662ed-61e2-4ea0-af4c-8ca4bd225fb4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037511 Feb 17 03:29:54.157566 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 290/571] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:29:54.162923 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6a415c23-f385-4b3f-a2db-16b2d56a6a38 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.163426 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6a415c23-f385-4b3f-a2db-16b2d56a6a38 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.164841 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6a415c23-f385-4b3f-a2db-16b2d56a6a38 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.165333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6a415c23-f385-4b3f-a2db-16b2d56a6a38 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.401635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6a415c23-f385-4b3f-a2db-16b2d56a6a38 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:54.411097 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6a415c23-f385-4b3f-a2db-16b2d56a6a38 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.261466 Feb 17 03:29:54.411705 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 282/572] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:54 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:54.714251 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4da2dd2e-c9b8-49fc-9711-a7f0246d079b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:54.714981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4da2dd2e-c9b8-49fc-9711-a7f0246d079b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:54.723634 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4da2dd2e-c9b8-49fc-9711-a7f0246d079b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.724139 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4da2dd2e-c9b8-49fc-9711-a7f0246d079b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.724955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4da2dd2e-c9b8-49fc-9711-a7f0246d079b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.725437 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4da2dd2e-c9b8-49fc-9711-a7f0246d079b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.799064 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4da2dd2e-c9b8-49fc-9711-a7f0246d079b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.799488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4da2dd2e-c9b8-49fc-9711-a7f0246d079b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.800017 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-4da2dd2e-c9b8-49fc-9711-a7f0246d079b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lazy-loading 'fault' on Instance uuid 08114034-f862-4a9a-a372-755e2b9a8b2f {{(pid=98183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:29:54.834933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ce18f6e2-d69f-46f8-8d05-f08cd92a8dc5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:54.835616 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ce18f6e2-d69f-46f8-8d05-f08cd92a8dc5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:54.844035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ce18f6e2-d69f-46f8-8d05-f08cd92a8dc5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.844525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ce18f6e2-d69f-46f8-8d05-f08cd92a8dc5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.845350 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ce18f6e2-d69f-46f8-8d05-f08cd92a8dc5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.845880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ce18f6e2-d69f-46f8-8d05-f08cd92a8dc5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.884162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4da2dd2e-c9b8-49fc-9711-a7f0246d079b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:54.897131 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4da2dd2e-c9b8-49fc-9711-a7f0246d079b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 200 len: 1307 microversion: 2.1 time: 0.187829 Feb 17 03:29:54.897727 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 291/573] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:54 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 1307 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:55.078861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ce18f6e2-d69f-46f8-8d05-f08cd92a8dc5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:55.090045 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ce18f6e2-d69f-46f8-8d05-f08cd92a8dc5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:55.092026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ce18f6e2-d69f-46f8-8d05-f08cd92a8dc5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:55.094782 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-da149260-97fd-4956-903e-2ad2364b34e4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:55.095526 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ce18f6e2-d69f-46f8-8d05-f08cd92a8dc5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1751 microversion: 2.20 time: 0.264015 Feb 17 03:29:55.095794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-da149260-97fd-4956-903e-2ad2364b34e4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:55.096506 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 283/574] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:54 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1751 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:29:55.104623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-da149260-97fd-4956-903e-2ad2364b34e4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.105218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-da149260-97fd-4956-903e-2ad2364b34e4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.106120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-da149260-97fd-4956-903e-2ad2364b34e4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.106610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-da149260-97fd-4956-903e-2ad2364b34e4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.166338 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-07071b3c-6be5-4016-9843-69494ea9d68f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:55.167003 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-07071b3c-6be5-4016-9843-69494ea9d68f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:55.175502 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-07071b3c-6be5-4016-9843-69494ea9d68f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.176034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-07071b3c-6be5-4016-9843-69494ea9d68f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.177113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-07071b3c-6be5-4016-9843-69494ea9d68f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.177585 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-07071b3c-6be5-4016-9843-69494ea9d68f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.619360 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-da149260-97fd-4956-903e-2ad2364b34e4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:55.628609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-da149260-97fd-4956-903e-2ad2364b34e4 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1318 microversion: 2.1 time: 0.538617 Feb 17 03:29:55.629261 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 292/575] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:55 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:55.634413 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b066aff3-7aa8-4c39-be60-e6d56d1df21a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:55.635072 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b066aff3-7aa8-4c39-be60-e6d56d1df21a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:55.642746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b066aff3-7aa8-4c39-be60-e6d56d1df21a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.643423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b066aff3-7aa8-4c39-be60-e6d56d1df21a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.644278 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b066aff3-7aa8-4c39-be60-e6d56d1df21a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.644837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b066aff3-7aa8-4c39-be60-e6d56d1df21a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.662444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-07071b3c-6be5-4016-9843-69494ea9d68f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:55.672541 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-07071b3c-6be5-4016-9843-69494ea9d68f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1560 microversion: 2.1 time: 0.510257 Feb 17 03:29:55.673182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 284/576] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:55 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1560 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:55.807399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9ec0306d-bc24-44a5-9a83-2fa0f140bc0b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:55.807977 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9ec0306d-bc24-44a5-9a83-2fa0f140bc0b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:55.815768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ec0306d-bc24-44a5-9a83-2fa0f140bc0b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.816284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ec0306d-bc24-44a5-9a83-2fa0f140bc0b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.817132 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ec0306d-bc24-44a5-9a83-2fa0f140bc0b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.817618 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ec0306d-bc24-44a5-9a83-2fa0f140bc0b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.868678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b066aff3-7aa8-4c39-be60-e6d56d1df21a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:55.878001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b066aff3-7aa8-4c39-be60-e6d56d1df21a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.247627 Feb 17 03:29:55.878597 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 293/577] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:55 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:55.916797 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-80328334-c388-48ba-966a-92e7d3dc637a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:55.917552 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-80328334-c388-48ba-966a-92e7d3dc637a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: 08114034-f862-4a9a-a372-755e2b9a8b2f] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:55.925549 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-80328334-c388-48ba-966a-92e7d3dc637a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.926130 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-80328334-c388-48ba-966a-92e7d3dc637a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.927044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-80328334-c388-48ba-966a-92e7d3dc637a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.927644 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-80328334-c388-48ba-966a-92e7d3dc637a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.991739 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-80328334-c388-48ba-966a-92e7d3dc637a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] HTTP exception thrown: Instance 08114034-f862-4a9a-a372-755e2b9a8b2f could not be found. Feb 17 03:29:55.992570 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-80328334-c388-48ba-966a-92e7d3dc637a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Returning 404 to user: Instance 08114034-f862-4a9a-a372-755e2b9a8b2f could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:29:55.993473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-80328334-c388-48ba-966a-92e7d3dc637a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f" status: 404 len: 111 microversion: 2.1 time: 0.081451 Feb 17 03:29:55.994258 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 294/578] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:55 2021] GET /compute/v2.1/servers/08114034-f862-4a9a-a372-755e2b9a8b2f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:29:56.007137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-9ec0306d-bc24-44a5-9a83-2fa0f140bc0b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lazy-loading 'services' on Instance uuid 6ec09d11-1456-48e6-9b4a-cbb0c7775f78 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:29:56.116321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-70269d9f-bed2-4275-834d-d4dfa36820f6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:56.116961 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-70269d9f-bed2-4275-834d-d4dfa36820f6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:56.125108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-70269d9f-bed2-4275-834d-d4dfa36820f6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.126082 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-70269d9f-bed2-4275-834d-d4dfa36820f6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.126949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-70269d9f-bed2-4275-834d-d4dfa36820f6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.127438 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-70269d9f-bed2-4275-834d-d4dfa36820f6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.307177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9ec0306d-bc24-44a5-9a83-2fa0f140bc0b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/os-volume_attachments/d53943fa-053a-415a-8624-2edca6d7181c" status: 202 len: 0 microversion: 2.1 time: 0.503641 Feb 17 03:29:56.311253 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 285/579] 10.222.0.46 () {58 vars in 1406 bytes} [Wed Feb 17 03:29:55 2021] DELETE /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78/os-volume_attachments/d53943fa-053a-415a-8624-2edca6d7181c => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:56.314724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-298319df-9e16-4b7f-a297-5b28a8c5d5c7 req-c973b527-0a42-492d-9fb7-edfbbdc94862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb66928f-13b6-4bf2-909c-6c9b985bf446", "name": "network-vif-plugged", "status": "completed", "tag": "82841018-3a77-4f6c-ba00-647e073193cc"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:56.316747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:56.316747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:29:56.327955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-298319df-9e16-4b7f-a297-5b28a8c5d5c7 req-c973b527-0a42-492d-9fb7-edfbbdc94862 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.328536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-298319df-9e16-4b7f-a297-5b28a8c5d5c7 req-c973b527-0a42-492d-9fb7-edfbbdc94862 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.347222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-298319df-9e16-4b7f-a297-5b28a8c5d5c7 req-c973b527-0a42-492d-9fb7-edfbbdc94862 service nova] Creating event network-vif-plugged:82841018-3a77-4f6c-ba00-647e073193cc for instance eb66928f-13b6-4bf2-909c-6c9b985bf446 on hv-cinder-75996 Feb 17 03:29:56.352628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-298319df-9e16-4b7f-a297-5b28a8c5d5c7 req-c973b527-0a42-492d-9fb7-edfbbdc94862 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042891 Feb 17 03:29:56.353301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 286/580] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:29:56.627149 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-70269d9f-bed2-4275-834d-d4dfa36820f6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:56.637951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-70269d9f-bed2-4275-834d-d4dfa36820f6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:56.639532 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-70269d9f-bed2-4275-834d-d4dfa36820f6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:56.640726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-70269d9f-bed2-4275-834d-d4dfa36820f6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1751 microversion: 2.20 time: 0.528830 Feb 17 03:29:56.643174 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 295/581] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:56 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1751 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:56.646931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fcae6c20-ab00-4a7f-af8e-fe5fd2787f5b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:56.647723 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fcae6c20-ab00-4a7f-af8e-fe5fd2787f5b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:56.655850 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fcae6c20-ab00-4a7f-af8e-fe5fd2787f5b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.656360 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fcae6c20-ab00-4a7f-af8e-fe5fd2787f5b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.657199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fcae6c20-ab00-4a7f-af8e-fe5fd2787f5b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.657686 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fcae6c20-ab00-4a7f-af8e-fe5fd2787f5b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.896437 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-219f0918-3291-4e26-86b4-fccba945e23c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:56.897102 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-219f0918-3291-4e26-86b4-fccba945e23c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:56.905092 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-219f0918-3291-4e26-86b4-fccba945e23c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.905593 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-219f0918-3291-4e26-86b4-fccba945e23c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.906419 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-219f0918-3291-4e26-86b4-fccba945e23c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.906907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-219f0918-3291-4e26-86b4-fccba945e23c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.941811 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fcae6c20-ab00-4a7f-af8e-fe5fd2787f5b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:56.950750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fcae6c20-ab00-4a7f-af8e-fe5fd2787f5b tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1318 microversion: 2.1 time: 0.308208 Feb 17 03:29:56.951353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 287/582] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:56 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:57.126118 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-219f0918-3291-4e26-86b4-fccba945e23c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:57.135898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-219f0918-3291-4e26-86b4-fccba945e23c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.243296 Feb 17 03:29:57.136442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 296/583] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:56 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:57.395287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ffccb415-edab-4055-869e-75208b9055be tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:57.396236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ffccb415-edab-4055-869e-75208b9055be tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:57.415968 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ffccb415-edab-4055-869e-75208b9055be tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:57.416678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ffccb415-edab-4055-869e-75208b9055be tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:57.417753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ffccb415-edab-4055-869e-75208b9055be tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:57.418440 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ffccb415-edab-4055-869e-75208b9055be tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:57.517061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ffccb415-edab-4055-869e-75208b9055be tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Going to try to terminate instance {{(pid=98184) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:29:57.668365 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f76d2cc6-3754-459b-9e6a-7ce3cb272b46 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:57.669421 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f76d2cc6-3754-459b-9e6a-7ce3cb272b46 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:57.680722 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ffccb415-edab-4055-869e-75208b9055be tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 204 len: 0 microversion: 2.1 time: 0.288485 Feb 17 03:29:57.680870 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f76d2cc6-3754-459b-9e6a-7ce3cb272b46 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:57.681605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f76d2cc6-3754-459b-9e6a-7ce3cb272b46 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:57.682781 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f76d2cc6-3754-459b-9e6a-7ce3cb272b46 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:57.683469 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f76d2cc6-3754-459b-9e6a-7ce3cb272b46 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:57.685212 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 288/584] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:29:57 2021] DELETE /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:29:57.694580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ace7595b-2119-4603-803d-c2a2bed06234 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:57.696159 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ace7595b-2119-4603-803d-c2a2bed06234 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:57.704725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ace7595b-2119-4603-803d-c2a2bed06234 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:57.705221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ace7595b-2119-4603-803d-c2a2bed06234 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:57.706395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ace7595b-2119-4603-803d-c2a2bed06234 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:57.706885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ace7595b-2119-4603-803d-c2a2bed06234 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:58.012855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f76d2cc6-3754-459b-9e6a-7ce3cb272b46 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:58.017307 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ace7595b-2119-4603-803d-c2a2bed06234 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:58.023739 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f76d2cc6-3754-459b-9e6a-7ce3cb272b46 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:58.025432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f76d2cc6-3754-459b-9e6a-7ce3cb272b46 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:58.026695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f76d2cc6-3754-459b-9e6a-7ce3cb272b46 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1751 microversion: 2.20 time: 0.368768 Feb 17 03:29:58.027136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ace7595b-2119-4603-803d-c2a2bed06234 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.337921 Feb 17 03:29:58.027426 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 297/585] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:57 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1751 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:58.028117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 289/586] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:57 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:58.032850 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b5b592b0-3529-453e-9f05-16be9b7e5a70 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:58.033592 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b5b592b0-3529-453e-9f05-16be9b7e5a70 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:58.042998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5b592b0-3529-453e-9f05-16be9b7e5a70 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:58.043529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5b592b0-3529-453e-9f05-16be9b7e5a70 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:58.044374 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5b592b0-3529-453e-9f05-16be9b7e5a70 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:58.044868 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5b592b0-3529-453e-9f05-16be9b7e5a70 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:58.154547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8436006b-20a3-406d-9769-60b7df466930 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:58.155179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8436006b-20a3-406d-9769-60b7df466930 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:58.162871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8436006b-20a3-406d-9769-60b7df466930 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:58.163468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8436006b-20a3-406d-9769-60b7df466930 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:58.164396 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8436006b-20a3-406d-9769-60b7df466930 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:58.164890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8436006b-20a3-406d-9769-60b7df466930 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:58.333340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b5b592b0-3529-453e-9f05-16be9b7e5a70 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:58.343528 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b5b592b0-3529-453e-9f05-16be9b7e5a70 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1318 microversion: 2.1 time: 0.313961 Feb 17 03:29:58.347948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 290/587] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:58 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:58.422189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8436006b-20a3-406d-9769-60b7df466930 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:58.432397 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8436006b-20a3-406d-9769-60b7df466930 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.281935 Feb 17 03:29:58.432954 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 298/588] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:58 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:59.046370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d92f7c95-ce68-4fc2-86f4-a5b73515de16 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:59.051882 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6c69c954-2561-4677-b57f-0f931bbb8275 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:59.052665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6c69c954-2561-4677-b57f-0f931bbb8275 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:59.053509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d92f7c95-ce68-4fc2-86f4-a5b73515de16 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:59.077060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c69c954-2561-4677-b57f-0f931bbb8275 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:59.077060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c69c954-2561-4677-b57f-0f931bbb8275 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:59.078009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d92f7c95-ce68-4fc2-86f4-a5b73515de16 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:59.078270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c69c954-2561-4677-b57f-0f931bbb8275 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:59.078270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c69c954-2561-4677-b57f-0f931bbb8275 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:59.078488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d92f7c95-ce68-4fc2-86f4-a5b73515de16 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:59.079031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d92f7c95-ce68-4fc2-86f4-a5b73515de16 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:59.081335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d92f7c95-ce68-4fc2-86f4-a5b73515de16 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:59.684805 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d92f7c95-ce68-4fc2-86f4-a5b73515de16 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:59.695079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d92f7c95-ce68-4fc2-86f4-a5b73515de16 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.652539 Feb 17 03:29:59.706031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 291/589] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:59 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:59.711479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6c69c954-2561-4677-b57f-0f931bbb8275 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:59.712028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cf6f5786-743d-4221-9b74-82e1467e8cc7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:59.712687 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cf6f5786-743d-4221-9b74-82e1467e8cc7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:59.721303 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf6f5786-743d-4221-9b74-82e1467e8cc7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:59.722023 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf6f5786-743d-4221-9b74-82e1467e8cc7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:59.723282 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6c69c954-2561-4677-b57f-0f931bbb8275 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:59.723437 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf6f5786-743d-4221-9b74-82e1467e8cc7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:59.723910 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf6f5786-743d-4221-9b74-82e1467e8cc7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:59.724907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6c69c954-2561-4677-b57f-0f931bbb8275 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:59.726100 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6c69c954-2561-4677-b57f-0f931bbb8275 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.678359 Feb 17 03:29:59.727638 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 299/590] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:29:59 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:59.732487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-74ac0c87-d36d-400a-b023-29e236fb022f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:59.733331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-74ac0c87-d36d-400a-b023-29e236fb022f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:59.743403 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-74ac0c87-d36d-400a-b023-29e236fb022f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:59.743932 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-74ac0c87-d36d-400a-b023-29e236fb022f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:59.744767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-74ac0c87-d36d-400a-b023-29e236fb022f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:59.745251 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-74ac0c87-d36d-400a-b023-29e236fb022f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:00.086976 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-74ac0c87-d36d-400a-b023-29e236fb022f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:00.098374 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cf6f5786-743d-4221-9b74-82e1467e8cc7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:00.118271 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cf6f5786-743d-4221-9b74-82e1467e8cc7 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1507 microversion: 2.1 time: 0.410646 Feb 17 03:30:00.118848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 292/591] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:59 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:00.120665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-74ac0c87-d36d-400a-b023-29e236fb022f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.391698 Feb 17 03:30:00.131403 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 300/592] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:59 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:00.138793 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fde14abf-b798-4a2c-b1f5-eef44e471f03 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8af21aa-40a3-4277-ac34-079d86160f44", "device": "/dev/sdb"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:00.140400 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fde14abf-b798-4a2c-b1f5-eef44e471f03 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:00.152010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fde14abf-b798-4a2c-b1f5-eef44e471f03 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:00.153163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fde14abf-b798-4a2c-b1f5-eef44e471f03 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:00.155055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fde14abf-b798-4a2c-b1f5-eef44e471f03 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:00.155914 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fde14abf-b798-4a2c-b1f5-eef44e471f03 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:00.714214 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b15b652a-b2e2-4062-896c-c9ed326105ff tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:00.714880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b15b652a-b2e2-4062-896c-c9ed326105ff tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:00.723143 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b15b652a-b2e2-4062-896c-c9ed326105ff tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:00.724026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b15b652a-b2e2-4062-896c-c9ed326105ff tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:00.725027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b15b652a-b2e2-4062-896c-c9ed326105ff tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:00.725671 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b15b652a-b2e2-4062-896c-c9ed326105ff tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:00.969159 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b15b652a-b2e2-4062-896c-c9ed326105ff tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:00.979483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b15b652a-b2e2-4062-896c-c9ed326105ff tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.269837 Feb 17 03:30:00.990296 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 301/593] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:00 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:00.994544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f7975481-207d-4fbc-8d94-6d83e0f1d043 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:00.995347 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f7975481-207d-4fbc-8d94-6d83e0f1d043 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:01.003994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f7975481-207d-4fbc-8d94-6d83e0f1d043 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:01.004743 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f7975481-207d-4fbc-8d94-6d83e0f1d043 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:01.005667 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f7975481-207d-4fbc-8d94-6d83e0f1d043 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:01.006518 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f7975481-207d-4fbc-8d94-6d83e0f1d043 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:01.277436 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f7975481-207d-4fbc-8d94-6d83e0f1d043 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:01.290659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f7975481-207d-4fbc-8d94-6d83e0f1d043 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:01.296676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f7975481-207d-4fbc-8d94-6d83e0f1d043 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:01.297994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f7975481-207d-4fbc-8d94-6d83e0f1d043 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.316410 Feb 17 03:30:01.298824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 302/594] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:00 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:01.303477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c9c2f53a-5ab4-4446-9dcc-33822b83075d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:01.308430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c9c2f53a-5ab4-4446-9dcc-33822b83075d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:01.316858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c9c2f53a-5ab4-4446-9dcc-33822b83075d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:01.317523 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c9c2f53a-5ab4-4446-9dcc-33822b83075d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:01.318360 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c9c2f53a-5ab4-4446-9dcc-33822b83075d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:01.318842 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c9c2f53a-5ab4-4446-9dcc-33822b83075d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:01.543668 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c9c2f53a-5ab4-4446-9dcc-33822b83075d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:01.553205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c9c2f53a-5ab4-4446-9dcc-33822b83075d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.253563 Feb 17 03:30:01.553801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 303/595] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:01 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:01.558599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f9acb58b-59b1-4bae-8302-5a04fe40ac34 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:01.559138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f9acb58b-59b1-4bae-8302-5a04fe40ac34 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:01.566605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f9acb58b-59b1-4bae-8302-5a04fe40ac34 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:01.567101 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f9acb58b-59b1-4bae-8302-5a04fe40ac34 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:01.567993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f9acb58b-59b1-4bae-8302-5a04fe40ac34 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:01.568484 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f9acb58b-59b1-4bae-8302-5a04fe40ac34 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:01.637135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f9acb58b-59b1-4bae-8302-5a04fe40ac34 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Going to try to terminate instance {{(pid=98183) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:30:01.767565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f9acb58b-59b1-4bae-8302-5a04fe40ac34 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 204 len: 0 microversion: 2.1 time: 0.212367 Feb 17 03:30:01.768213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 304/596] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:30:01 2021] DELETE /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:30:01.777427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-29badf77-451b-4ccc-91d5-7130280dacfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:01.778169 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-29badf77-451b-4ccc-91d5-7130280dacfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:01.786727 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-29badf77-451b-4ccc-91d5-7130280dacfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:01.787221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-29badf77-451b-4ccc-91d5-7130280dacfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:01.788113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-29badf77-451b-4ccc-91d5-7130280dacfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:01.788609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-29badf77-451b-4ccc-91d5-7130280dacfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:02.009534 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-29badf77-451b-4ccc-91d5-7130280dacfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:02.027970 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-29badf77-451b-4ccc-91d5-7130280dacfe tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1507 microversion: 2.1 time: 0.255088 Feb 17 03:30:02.028737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 305/597] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:01 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:02.040192 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b716a366-c7db-49c4-adf3-4cc0cb1d2dc4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:02.040854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b716a366-c7db-49c4-adf3-4cc0cb1d2dc4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:02.049280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b716a366-c7db-49c4-adf3-4cc0cb1d2dc4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:02.049785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b716a366-c7db-49c4-adf3-4cc0cb1d2dc4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:02.050622 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b716a366-c7db-49c4-adf3-4cc0cb1d2dc4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:02.051107 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b716a366-c7db-49c4-adf3-4cc0cb1d2dc4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:02.277691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b716a366-c7db-49c4-adf3-4cc0cb1d2dc4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:02.287109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b716a366-c7db-49c4-adf3-4cc0cb1d2dc4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.250700 Feb 17 03:30:02.287728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 306/598] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:02 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:02.318520 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a9174c59-7499-476c-a173-c52f3285e138 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:02.319779 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a9174c59-7499-476c-a173-c52f3285e138 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:02.327753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a9174c59-7499-476c-a173-c52f3285e138 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:02.328249 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a9174c59-7499-476c-a173-c52f3285e138 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:02.329072 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a9174c59-7499-476c-a173-c52f3285e138 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:02.329555 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a9174c59-7499-476c-a173-c52f3285e138 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:02.544313 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a9174c59-7499-476c-a173-c52f3285e138 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:02.554015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a9174c59-7499-476c-a173-c52f3285e138 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:02.555593 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a9174c59-7499-476c-a173-c52f3285e138 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:02.556746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a9174c59-7499-476c-a173-c52f3285e138 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.242306 Feb 17 03:30:02.557323 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 307/599] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:02 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:30:02.571849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6813d93c-8770-4174-9566-bcc83a9ab0f9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:02.572506 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6813d93c-8770-4174-9566-bcc83a9ab0f9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:02.580032 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6813d93c-8770-4174-9566-bcc83a9ab0f9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:02.580515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6813d93c-8770-4174-9566-bcc83a9ab0f9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:02.581342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6813d93c-8770-4174-9566-bcc83a9ab0f9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:02.581835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6813d93c-8770-4174-9566-bcc83a9ab0f9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:02.824858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6813d93c-8770-4174-9566-bcc83a9ab0f9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:02.835129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6813d93c-8770-4174-9566-bcc83a9ab0f9 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.267482 Feb 17 03:30:02.836315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 308/600] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:02 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:03.046280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-18f743e4-071e-4640-952b-9eb844e4cc70 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:03.046943 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-18f743e4-071e-4640-952b-9eb844e4cc70 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:03.054767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-18f743e4-071e-4640-952b-9eb844e4cc70 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:03.055808 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-18f743e4-071e-4640-952b-9eb844e4cc70 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:03.056639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-18f743e4-071e-4640-952b-9eb844e4cc70 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:03.057128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-18f743e4-071e-4640-952b-9eb844e4cc70 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:03.301734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-18f743e4-071e-4640-952b-9eb844e4cc70 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:03.311843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-18f743e4-071e-4640-952b-9eb844e4cc70 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1507 microversion: 2.1 time: 0.269475 Feb 17 03:30:03.312456 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 309/601] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:03 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:03.325967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cfeb8271-f885-4382-9e7a-09a2133c4853 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:03.326623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cfeb8271-f885-4382-9e7a-09a2133c4853 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:03.334483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cfeb8271-f885-4382-9e7a-09a2133c4853 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:03.334980 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cfeb8271-f885-4382-9e7a-09a2133c4853 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:03.335854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cfeb8271-f885-4382-9e7a-09a2133c4853 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:03.336376 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cfeb8271-f885-4382-9e7a-09a2133c4853 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:03.575208 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cfeb8271-f885-4382-9e7a-09a2133c4853 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:03.584533 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cfeb8271-f885-4382-9e7a-09a2133c4853 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.262451 Feb 17 03:30:03.585144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 310/602] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:03 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:03.590639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1f67ca17-3b37-4a32-9d2b-88242c503bbc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:03.591295 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1f67ca17-3b37-4a32-9d2b-88242c503bbc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:03.599786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f67ca17-3b37-4a32-9d2b-88242c503bbc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:03.600287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f67ca17-3b37-4a32-9d2b-88242c503bbc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:03.601122 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f67ca17-3b37-4a32-9d2b-88242c503bbc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:03.601605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f67ca17-3b37-4a32-9d2b-88242c503bbc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:03.823360 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1f67ca17-3b37-4a32-9d2b-88242c503bbc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:03.833465 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1f67ca17-3b37-4a32-9d2b-88242c503bbc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:03.835014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1f67ca17-3b37-4a32-9d2b-88242c503bbc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:03.836710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1f67ca17-3b37-4a32-9d2b-88242c503bbc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.250089 Feb 17 03:30:03.837299 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 311/603] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:03 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:03.855750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f85bd4b9-44df-4867-9009-36245fb340be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:03.856416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f85bd4b9-44df-4867-9009-36245fb340be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:03.870491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f85bd4b9-44df-4867-9009-36245fb340be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:03.870998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f85bd4b9-44df-4867-9009-36245fb340be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:03.871940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f85bd4b9-44df-4867-9009-36245fb340be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:03.872367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f85bd4b9-44df-4867-9009-36245fb340be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.100901 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f85bd4b9-44df-4867-9009-36245fb340be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:04.110818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f85bd4b9-44df-4867-9009-36245fb340be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.259770 Feb 17 03:30:04.111455 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 312/604] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:03 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:04.330168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fff31336-c3bc-4690-a966-ff90a8c8ee57 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:04.330756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fff31336-c3bc-4690-a966-ff90a8c8ee57 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:04.338797 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fff31336-c3bc-4690-a966-ff90a8c8ee57 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.339299 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fff31336-c3bc-4690-a966-ff90a8c8ee57 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.340165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fff31336-c3bc-4690-a966-ff90a8c8ee57 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.340654 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fff31336-c3bc-4690-a966-ff90a8c8ee57 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.568916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fff31336-c3bc-4690-a966-ff90a8c8ee57 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:04.578704 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fff31336-c3bc-4690-a966-ff90a8c8ee57 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1507 microversion: 2.1 time: 0.252567 Feb 17 03:30:04.579503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 313/605] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:04 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:04.602897 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ebe6f581-5fd5-43a8-a572-83944c0d6989 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:04.603485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ebe6f581-5fd5-43a8-a572-83944c0d6989 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:04.613319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ebe6f581-5fd5-43a8-a572-83944c0d6989 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.613890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ebe6f581-5fd5-43a8-a572-83944c0d6989 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.614767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ebe6f581-5fd5-43a8-a572-83944c0d6989 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.615251 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ebe6f581-5fd5-43a8-a572-83944c0d6989 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.848042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ebe6f581-5fd5-43a8-a572-83944c0d6989 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:04.857922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ebe6f581-5fd5-43a8-a572-83944c0d6989 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.259145 Feb 17 03:30:04.868991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 314/606] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:04 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:04.868991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0788ed5a-ce16-4339-b83d-3ada2128af0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:04.868991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0788ed5a-ce16-4339-b83d-3ada2128af0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:04.872378 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0788ed5a-ce16-4339-b83d-3ada2128af0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.872881 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0788ed5a-ce16-4339-b83d-3ada2128af0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.873726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0788ed5a-ce16-4339-b83d-3ada2128af0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.874214 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0788ed5a-ce16-4339-b83d-3ada2128af0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.120150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0788ed5a-ce16-4339-b83d-3ada2128af0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:05.130355 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0788ed5a-ce16-4339-b83d-3ada2128af0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:05.131930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0788ed5a-ce16-4339-b83d-3ada2128af0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:05.133146 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0788ed5a-ce16-4339-b83d-3ada2128af0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.273603 Feb 17 03:30:05.133731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 315/607] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:04 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:05.145044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-256ec8d2-547a-43ad-82fb-d720121f2e6e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:05.145044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-256ec8d2-547a-43ad-82fb-d720121f2e6e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:05.150492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-256ec8d2-547a-43ad-82fb-d720121f2e6e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.150492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-256ec8d2-547a-43ad-82fb-d720121f2e6e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.150492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-256ec8d2-547a-43ad-82fb-d720121f2e6e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.150492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-256ec8d2-547a-43ad-82fb-d720121f2e6e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.171110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:30:05.171353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:30:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446/os-volume_attachments (ip 10.222.0.46) !!! Feb 17 03:30:05.383116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-256ec8d2-547a-43ad-82fb-d720121f2e6e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:05.392673 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-256ec8d2-547a-43ad-82fb-d720121f2e6e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.257930 Feb 17 03:30:05.393268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 316/608] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:05 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:05.598765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fda1b215-0321-439e-888b-dc510f734de1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:05.599453 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fda1b215-0321-439e-888b-dc510f734de1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:05.608405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fda1b215-0321-439e-888b-dc510f734de1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.610208 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fda1b215-0321-439e-888b-dc510f734de1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.611103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fda1b215-0321-439e-888b-dc510f734de1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.611614 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fda1b215-0321-439e-888b-dc510f734de1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.838245 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fda1b215-0321-439e-888b-dc510f734de1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:05.847341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fda1b215-0321-439e-888b-dc510f734de1 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1507 microversion: 2.1 time: 0.253114 Feb 17 03:30:05.848257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 317/609] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:05 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:05.880060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c9f24355-dc0b-4028-924a-eee26d451b0c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:05.880990 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c9f24355-dc0b-4028-924a-eee26d451b0c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:05.890667 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c9f24355-dc0b-4028-924a-eee26d451b0c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.891147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c9f24355-dc0b-4028-924a-eee26d451b0c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.892036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c9f24355-dc0b-4028-924a-eee26d451b0c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.892518 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c9f24355-dc0b-4028-924a-eee26d451b0c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:06.126352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c9f24355-dc0b-4028-924a-eee26d451b0c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:06.137049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c9f24355-dc0b-4028-924a-eee26d451b0c tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.260419 Feb 17 03:30:06.137049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 318/610] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:05 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:06.152602 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a61ac25d-4029-4869-bce3-9d2cce53d361 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:06.153262 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a61ac25d-4029-4869-bce3-9d2cce53d361 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:06.161268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a61ac25d-4029-4869-bce3-9d2cce53d361 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:06.161769 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a61ac25d-4029-4869-bce3-9d2cce53d361 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:06.162612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a61ac25d-4029-4869-bce3-9d2cce53d361 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:06.163095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a61ac25d-4029-4869-bce3-9d2cce53d361 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:06.452473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a61ac25d-4029-4869-bce3-9d2cce53d361 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:06.464212 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a61ac25d-4029-4869-bce3-9d2cce53d361 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:06.465773 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a61ac25d-4029-4869-bce3-9d2cce53d361 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:06.467051 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a61ac25d-4029-4869-bce3-9d2cce53d361 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.318372 Feb 17 03:30:06.467702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 319/611] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:06 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:30:06.472303 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c18c0bf4-ef04-4190-94d7-2335f54b6a04 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:06.473242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c18c0bf4-ef04-4190-94d7-2335f54b6a04 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:06.486093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c18c0bf4-ef04-4190-94d7-2335f54b6a04 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:06.486684 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c18c0bf4-ef04-4190-94d7-2335f54b6a04 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:06.487887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c18c0bf4-ef04-4190-94d7-2335f54b6a04 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:06.488467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c18c0bf4-ef04-4190-94d7-2335f54b6a04 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:06.739138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c18c0bf4-ef04-4190-94d7-2335f54b6a04 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:06.749174 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c18c0bf4-ef04-4190-94d7-2335f54b6a04 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.280438 Feb 17 03:30:06.750004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 320/612] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:06 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:06.864807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-24dec76a-79bb-444e-9b51-2f839e6b6a28 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:06.865460 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-24dec76a-79bb-444e-9b51-2f839e6b6a28 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:06.873359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-24dec76a-79bb-444e-9b51-2f839e6b6a28 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:06.873850 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-24dec76a-79bb-444e-9b51-2f839e6b6a28 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:06.874663 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-24dec76a-79bb-444e-9b51-2f839e6b6a28 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:06.875146 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-24dec76a-79bb-444e-9b51-2f839e6b6a28 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:07.104986 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-24dec76a-79bb-444e-9b51-2f839e6b6a28 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:07.118268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-24dec76a-79bb-444e-9b51-2f839e6b6a28 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1507 microversion: 2.1 time: 0.257168 Feb 17 03:30:07.118913 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 321/613] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:06 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:07.155282 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b1d417e8-a855-47b1-9b9b-001bdd1e14a9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:07.156061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b1d417e8-a855-47b1-9b9b-001bdd1e14a9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:07.164236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1d417e8-a855-47b1-9b9b-001bdd1e14a9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:07.164830 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1d417e8-a855-47b1-9b9b-001bdd1e14a9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:07.165745 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1d417e8-a855-47b1-9b9b-001bdd1e14a9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:07.166397 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1d417e8-a855-47b1-9b9b-001bdd1e14a9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:07.398305 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b1d417e8-a855-47b1-9b9b-001bdd1e14a9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:07.407607 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b1d417e8-a855-47b1-9b9b-001bdd1e14a9 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.256425 Feb 17 03:30:07.408849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 322/614] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:07 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:07.488252 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f0d3f274-23c9-4ab1-9477-571d15b8e926 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:07.489327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f0d3f274-23c9-4ab1-9477-571d15b8e926 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:07.497907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f0d3f274-23c9-4ab1-9477-571d15b8e926 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:07.498398 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f0d3f274-23c9-4ab1-9477-571d15b8e926 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:07.499225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f0d3f274-23c9-4ab1-9477-571d15b8e926 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:07.499732 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f0d3f274-23c9-4ab1-9477-571d15b8e926 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:07.734788 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f0d3f274-23c9-4ab1-9477-571d15b8e926 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:07.745496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f0d3f274-23c9-4ab1-9477-571d15b8e926 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:07.747028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f0d3f274-23c9-4ab1-9477-571d15b8e926 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:07.748268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f0d3f274-23c9-4ab1-9477-571d15b8e926 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.264917 Feb 17 03:30:07.748906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 323/615] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:07 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:30:07.769964 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2d91db1d-bb41-4dfd-8e5d-f18cde94b6b4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:07.770794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2d91db1d-bb41-4dfd-8e5d-f18cde94b6b4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:07.791676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d91db1d-bb41-4dfd-8e5d-f18cde94b6b4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:07.792184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d91db1d-bb41-4dfd-8e5d-f18cde94b6b4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:07.793046 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d91db1d-bb41-4dfd-8e5d-f18cde94b6b4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:07.793545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d91db1d-bb41-4dfd-8e5d-f18cde94b6b4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.045233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2d91db1d-bb41-4dfd-8e5d-f18cde94b6b4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:08.055878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2d91db1d-bb41-4dfd-8e5d-f18cde94b6b4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.289220 Feb 17 03:30:08.056707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 324/616] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:07 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:08.137365 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1f64e5ca-9f04-4523-96e8-0318a53f42bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:08.138036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1f64e5ca-9f04-4523-96e8-0318a53f42bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:08.146024 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f64e5ca-9f04-4523-96e8-0318a53f42bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.146529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f64e5ca-9f04-4523-96e8-0318a53f42bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.147364 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f64e5ca-9f04-4523-96e8-0318a53f42bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.147887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f64e5ca-9f04-4523-96e8-0318a53f42bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.373138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1f64e5ca-9f04-4523-96e8-0318a53f42bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:08.381959 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1f64e5ca-9f04-4523-96e8-0318a53f42bd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1507 microversion: 2.1 time: 0.248650 Feb 17 03:30:08.382553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 325/617] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:08 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:08.425956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9b7756a5-9c87-443d-9ade-f829c1a539c8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:08.426615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9b7756a5-9c87-443d-9ade-f829c1a539c8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:08.434733 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9b7756a5-9c87-443d-9ade-f829c1a539c8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.435229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9b7756a5-9c87-443d-9ade-f829c1a539c8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.436096 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9b7756a5-9c87-443d-9ade-f829c1a539c8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.436581 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9b7756a5-9c87-443d-9ade-f829c1a539c8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.882884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9b7756a5-9c87-443d-9ade-f829c1a539c8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:08.892215 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9b7756a5-9c87-443d-9ade-f829c1a539c8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.470139 Feb 17 03:30:08.892840 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 326/618] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:08 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:08.898206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f17ad405-7ea0-4ca2-83ca-78531856112b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:08.899423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f17ad405-7ea0-4ca2-83ca-78531856112b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:08.907860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f17ad405-7ea0-4ca2-83ca-78531856112b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.908399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f17ad405-7ea0-4ca2-83ca-78531856112b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.909243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f17ad405-7ea0-4ca2-83ca-78531856112b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.909733 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f17ad405-7ea0-4ca2-83ca-78531856112b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.140470 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f17ad405-7ea0-4ca2-83ca-78531856112b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:09.154168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f17ad405-7ea0-4ca2-83ca-78531856112b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:09.155990 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f17ad405-7ea0-4ca2-83ca-78531856112b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:09.157153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f17ad405-7ea0-4ca2-83ca-78531856112b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.263311 Feb 17 03:30:09.158066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 327/619] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:08 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:09.162648 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7be246b6-833d-4d5a-8f15-68ab7b4da827 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:09.163310 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7be246b6-833d-4d5a-8f15-68ab7b4da827 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:09.172411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7be246b6-833d-4d5a-8f15-68ab7b4da827 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.172909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7be246b6-833d-4d5a-8f15-68ab7b4da827 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.173744 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7be246b6-833d-4d5a-8f15-68ab7b4da827 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.174231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7be246b6-833d-4d5a-8f15-68ab7b4da827 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.403482 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7be246b6-833d-4d5a-8f15-68ab7b4da827 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:09.412792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7be246b6-833d-4d5a-8f15-68ab7b4da827 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.253698 Feb 17 03:30:09.413385 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 328/620] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:09 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:09.417936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0d62ce1c-dd7b-4a64-8ad5-5ccaa60d775b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:09.418582 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0d62ce1c-dd7b-4a64-8ad5-5ccaa60d775b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:09.425979 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d62ce1c-dd7b-4a64-8ad5-5ccaa60d775b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.426455 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d62ce1c-dd7b-4a64-8ad5-5ccaa60d775b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.427274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d62ce1c-dd7b-4a64-8ad5-5ccaa60d775b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.427785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d62ce1c-dd7b-4a64-8ad5-5ccaa60d775b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.667148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0d62ce1c-dd7b-4a64-8ad5-5ccaa60d775b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:09.676399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0d62ce1c-dd7b-4a64-8ad5-5ccaa60d775b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1507 microversion: 2.1 time: 0.261857 Feb 17 03:30:09.676908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 329/621] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:09 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:09.910604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a4bdad81-4e50-487e-8f99-4dfe096f01c4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:09.911176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a4bdad81-4e50-487e-8f99-4dfe096f01c4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:09.919562 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a4bdad81-4e50-487e-8f99-4dfe096f01c4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.920041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a4bdad81-4e50-487e-8f99-4dfe096f01c4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.920856 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a4bdad81-4e50-487e-8f99-4dfe096f01c4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.921331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a4bdad81-4e50-487e-8f99-4dfe096f01c4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.146667 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a4bdad81-4e50-487e-8f99-4dfe096f01c4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:10.156958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a4bdad81-4e50-487e-8f99-4dfe096f01c4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.250297 Feb 17 03:30:10.157759 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 330/622] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:09 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:10.178997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4d15b8e8-8c4a-410f-8a53-f5a50266345f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:10.180428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4d15b8e8-8c4a-410f-8a53-f5a50266345f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:10.188626 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d15b8e8-8c4a-410f-8a53-f5a50266345f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.189116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d15b8e8-8c4a-410f-8a53-f5a50266345f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.190095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d15b8e8-8c4a-410f-8a53-f5a50266345f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.190571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d15b8e8-8c4a-410f-8a53-f5a50266345f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.413179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4d15b8e8-8c4a-410f-8a53-f5a50266345f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:10.424163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4d15b8e8-8c4a-410f-8a53-f5a50266345f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:10.425710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4d15b8e8-8c4a-410f-8a53-f5a50266345f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:10.426882 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4d15b8e8-8c4a-410f-8a53-f5a50266345f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.253066 Feb 17 03:30:10.427456 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 331/623] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:10 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:30:10.432082 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9df52236-f087-46a2-8b84-c87c878389b3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:10.432682 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9df52236-f087-46a2-8b84-c87c878389b3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:10.440232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9df52236-f087-46a2-8b84-c87c878389b3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.440737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9df52236-f087-46a2-8b84-c87c878389b3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.441550 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9df52236-f087-46a2-8b84-c87c878389b3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.442039 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9df52236-f087-46a2-8b84-c87c878389b3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.666050 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9df52236-f087-46a2-8b84-c87c878389b3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:10.675498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9df52236-f087-46a2-8b84-c87c878389b3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.247023 Feb 17 03:30:10.676120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 332/624] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:10 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:10.695234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ce8d2293-168c-4b14-acc8-c59d287a035b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:10.696375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ce8d2293-168c-4b14-acc8-c59d287a035b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:10.704235 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ce8d2293-168c-4b14-acc8-c59d287a035b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.704730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ce8d2293-168c-4b14-acc8-c59d287a035b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.705561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ce8d2293-168c-4b14-acc8-c59d287a035b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.706033 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ce8d2293-168c-4b14-acc8-c59d287a035b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.922878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ce8d2293-168c-4b14-acc8-c59d287a035b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:10.931908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ce8d2293-168c-4b14-acc8-c59d287a035b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1507 microversion: 2.1 time: 0.240321 Feb 17 03:30:10.932512 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 333/625] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:10 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:11.176011 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-19971289-8619-4e0e-8c38-62ebe2d2732a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:11.176663 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-19971289-8619-4e0e-8c38-62ebe2d2732a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:11.184951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19971289-8619-4e0e-8c38-62ebe2d2732a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.185444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19971289-8619-4e0e-8c38-62ebe2d2732a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.186252 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19971289-8619-4e0e-8c38-62ebe2d2732a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.186725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-19971289-8619-4e0e-8c38-62ebe2d2732a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.399394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-19971289-8619-4e0e-8c38-62ebe2d2732a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:11.408102 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-19971289-8619-4e0e-8c38-62ebe2d2732a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.236171 Feb 17 03:30:11.408694 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 334/626] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:11 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:11.445890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7a1da4a0-16ee-48c8-be4f-45f2a0b254eb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:11.446530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7a1da4a0-16ee-48c8-be4f-45f2a0b254eb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:11.453877 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7a1da4a0-16ee-48c8-be4f-45f2a0b254eb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.454367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7a1da4a0-16ee-48c8-be4f-45f2a0b254eb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.455180 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7a1da4a0-16ee-48c8-be4f-45f2a0b254eb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.455674 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7a1da4a0-16ee-48c8-be4f-45f2a0b254eb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.664997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7a1da4a0-16ee-48c8-be4f-45f2a0b254eb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:11.675256 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7a1da4a0-16ee-48c8-be4f-45f2a0b254eb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:11.676933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7a1da4a0-16ee-48c8-be4f-45f2a0b254eb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:11.678106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7a1da4a0-16ee-48c8-be4f-45f2a0b254eb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.235850 Feb 17 03:30:11.678691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 335/627] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:11 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:30:11.695804 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9cb725b3-2229-44a7-92c1-01b223d2ef73 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:11.696512 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9cb725b3-2229-44a7-92c1-01b223d2ef73 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:11.704521 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9cb725b3-2229-44a7-92c1-01b223d2ef73 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.705022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9cb725b3-2229-44a7-92c1-01b223d2ef73 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.705837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9cb725b3-2229-44a7-92c1-01b223d2ef73 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.706317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9cb725b3-2229-44a7-92c1-01b223d2ef73 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.905180 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fde14abf-b798-4a2c-b1f5-eef44e471f03 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "POST /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.770299 Feb 17 03:30:11.907257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 293/628] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:30:00 2021] POST /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446/os-volume_attachments => generated 194 bytes in 11773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:11.939728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9cb725b3-2229-44a7-92c1-01b223d2ef73 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:11.949513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9cb725b3-2229-44a7-92c1-01b223d2ef73 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.258976 Feb 17 03:30:11.951591 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7b05b63e-5bc3-427a-b3bd-577621a8970f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:11.952741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7b05b63e-5bc3-427a-b3bd-577621a8970f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:11.960448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 336/629] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:11 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:11.964007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7b05b63e-5bc3-427a-b3bd-577621a8970f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.964907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7b05b63e-5bc3-427a-b3bd-577621a8970f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.965746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7b05b63e-5bc3-427a-b3bd-577621a8970f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.966210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7b05b63e-5bc3-427a-b3bd-577621a8970f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:12.230778 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7b05b63e-5bc3-427a-b3bd-577621a8970f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:12.243068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7b05b63e-5bc3-427a-b3bd-577621a8970f tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1507 microversion: 2.1 time: 0.296488 Feb 17 03:30:12.243998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 294/630] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:11 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:12.426416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4e7765db-6bd2-4d25-9d9d-063e24f0875f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:12.426998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4e7765db-6bd2-4d25-9d9d-063e24f0875f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:12.434815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e7765db-6bd2-4d25-9d9d-063e24f0875f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:12.435309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e7765db-6bd2-4d25-9d9d-063e24f0875f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:12.436174 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e7765db-6bd2-4d25-9d9d-063e24f0875f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:12.436657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e7765db-6bd2-4d25-9d9d-063e24f0875f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:12.663206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4e7765db-6bd2-4d25-9d9d-063e24f0875f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:12.672039 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4e7765db-6bd2-4d25-9d9d-063e24f0875f tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.249583 Feb 17 03:30:12.672636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 337/631] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:12 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:12.698820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-71268628-ce8d-41a4-9093-f14f2b2c1b5f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:12.699481 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-71268628-ce8d-41a4-9093-f14f2b2c1b5f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:12.707313 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71268628-ce8d-41a4-9093-f14f2b2c1b5f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:12.707845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71268628-ce8d-41a4-9093-f14f2b2c1b5f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:12.708676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71268628-ce8d-41a4-9093-f14f2b2c1b5f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:12.709168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71268628-ce8d-41a4-9093-f14f2b2c1b5f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:12.921054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-71268628-ce8d-41a4-9093-f14f2b2c1b5f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:12.932320 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-71268628-ce8d-41a4-9093-f14f2b2c1b5f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:12.934062 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-71268628-ce8d-41a4-9093-f14f2b2c1b5f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:12.935319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-71268628-ce8d-41a4-9093-f14f2b2c1b5f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.241173 Feb 17 03:30:12.935974 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 295/632] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:12 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:12.967917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1321eef5-4a4d-4318-933c-aa165a7a2b8e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:12.968899 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1321eef5-4a4d-4318-933c-aa165a7a2b8e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:12.976938 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1321eef5-4a4d-4318-933c-aa165a7a2b8e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:12.977665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1321eef5-4a4d-4318-933c-aa165a7a2b8e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:12.979200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1321eef5-4a4d-4318-933c-aa165a7a2b8e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:12.979715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1321eef5-4a4d-4318-933c-aa165a7a2b8e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:13.217535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1321eef5-4a4d-4318-933c-aa165a7a2b8e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:13.227183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1321eef5-4a4d-4318-933c-aa165a7a2b8e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.263318 Feb 17 03:30:13.227843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 338/633] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:12 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:13.261269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-59e9e0cc-b626-4388-b113-8994adf1a3ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:13.261907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-59e9e0cc-b626-4388-b113-8994adf1a3ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:13.269579 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-59e9e0cc-b626-4388-b113-8994adf1a3ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:13.270075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-59e9e0cc-b626-4388-b113-8994adf1a3ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:13.270899 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-59e9e0cc-b626-4388-b113-8994adf1a3ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:13.271381 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-59e9e0cc-b626-4388-b113-8994adf1a3ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:13.486658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-59e9e0cc-b626-4388-b113-8994adf1a3ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:13.495571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-59e9e0cc-b626-4388-b113-8994adf1a3ed tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1507 microversion: 2.1 time: 0.238211 Feb 17 03:30:13.496217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 296/634] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:13 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:13.690405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4e4ca462-b85b-4088-936d-5cba1c9aa682 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:13.691244 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4e4ca462-b85b-4088-936d-5cba1c9aa682 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:13.699944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e4ca462-b85b-4088-936d-5cba1c9aa682 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:13.700480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e4ca462-b85b-4088-936d-5cba1c9aa682 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:13.701295 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e4ca462-b85b-4088-936d-5cba1c9aa682 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:13.701780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e4ca462-b85b-4088-936d-5cba1c9aa682 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:13.950491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-1879727c-25e5-4723-96b2-3480b20a8251 req-2081bc74-0fe6-419b-85e0-275ebaa37f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed401356-e52d-44a1-aa8a-96252fd9cc98", "name": "network-vif-unplugged", "status": "completed", "tag": "5e72f71c-333a-4cfd-859b-95ac38dfea5f"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:13.952209 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:30:13.952209 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:30:13.962898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-1879727c-25e5-4723-96b2-3480b20a8251 req-2081bc74-0fe6-419b-85e0-275ebaa37f93 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:13.963658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-1879727c-25e5-4723-96b2-3480b20a8251 req-2081bc74-0fe6-419b-85e0-275ebaa37f93 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:13.982002 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-1879727c-25e5-4723-96b2-3480b20a8251 req-2081bc74-0fe6-419b-85e0-275ebaa37f93 service nova] Creating event network-vif-unplugged:5e72f71c-333a-4cfd-859b-95ac38dfea5f for instance ed401356-e52d-44a1-aa8a-96252fd9cc98 on hv-cinder-75996 Feb 17 03:30:13.987931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-1879727c-25e5-4723-96b2-3480b20a8251 req-2081bc74-0fe6-419b-85e0-275ebaa37f93 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041930 Feb 17 03:30:13.989009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 297/635] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:30:13 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:13.995059 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3e1b6bdd-346b-474e-afc2-9d27bf4f2e30 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:13.996074 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3e1b6bdd-346b-474e-afc2-9d27bf4f2e30 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:14.006171 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e1b6bdd-346b-474e-afc2-9d27bf4f2e30 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:14.006921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e1b6bdd-346b-474e-afc2-9d27bf4f2e30 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:14.008027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e1b6bdd-346b-474e-afc2-9d27bf4f2e30 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:14.009837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e1b6bdd-346b-474e-afc2-9d27bf4f2e30 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:14.146092 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4e4ca462-b85b-4088-936d-5cba1c9aa682 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:14.157285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4e4ca462-b85b-4088-936d-5cba1c9aa682 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1514 microversion: 2.1 time: 0.470870 Feb 17 03:30:14.158686 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 339/636] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:13 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1514 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:14.247295 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-254e2214-d644-4b84-ad22-c6843530492a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:14.247425 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-254e2214-d644-4b84-ad22-c6843530492a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:14.273094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-254e2214-d644-4b84-ad22-c6843530492a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:14.273604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-254e2214-d644-4b84-ad22-c6843530492a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:14.274394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-254e2214-d644-4b84-ad22-c6843530492a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:14.274909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-254e2214-d644-4b84-ad22-c6843530492a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:14.610650 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3e1b6bdd-346b-474e-afc2-9d27bf4f2e30 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:14.621695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3e1b6bdd-346b-474e-afc2-9d27bf4f2e30 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:14.623309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3e1b6bdd-346b-474e-afc2-9d27bf4f2e30 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:14.624602 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3e1b6bdd-346b-474e-afc2-9d27bf4f2e30 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.634209 Feb 17 03:30:14.625194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 298/637] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:13 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:14.629967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0c7f0dac-77ee-4cf2-aae5-2497ab25f135 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:14.630630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0c7f0dac-77ee-4cf2-aae5-2497ab25f135 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:14.638311 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c7f0dac-77ee-4cf2-aae5-2497ab25f135 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:14.638830 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c7f0dac-77ee-4cf2-aae5-2497ab25f135 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:14.639695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c7f0dac-77ee-4cf2-aae5-2497ab25f135 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:14.640193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c7f0dac-77ee-4cf2-aae5-2497ab25f135 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:14.810747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-254e2214-d644-4b84-ad22-c6843530492a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:14.820306 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-254e2214-d644-4b84-ad22-c6843530492a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.578212 Feb 17 03:30:14.820913 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 340/638] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:14 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:15.099061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0c7f0dac-77ee-4cf2-aae5-2497ab25f135 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:15.108921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0c7f0dac-77ee-4cf2-aae5-2497ab25f135 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1507 microversion: 2.1 time: 0.482518 Feb 17 03:30:15.109724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 299/639] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:14 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1507 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:15.112175 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-8a4a492d-e8f8-4f91-a758-2d5828b2c7a1 req-31647878-d441-4204-83c4-6d9f5fd3b36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed401356-e52d-44a1-aa8a-96252fd9cc98", "name": "network-vif-deleted", "tag": "5e72f71c-333a-4cfd-859b-95ac38dfea5f"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:15.113949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:30:15.113949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:30:15.123153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-8a4a492d-e8f8-4f91-a758-2d5828b2c7a1 req-31647878-d441-4204-83c4-6d9f5fd3b36d service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:15.123666 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-8a4a492d-e8f8-4f91-a758-2d5828b2c7a1 req-31647878-d441-4204-83c4-6d9f5fd3b36d service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:15.142420 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-8a4a492d-e8f8-4f91-a758-2d5828b2c7a1 req-31647878-d441-4204-83c4-6d9f5fd3b36d service nova] Creating event network-vif-deleted:5e72f71c-333a-4cfd-859b-95ac38dfea5f for instance ed401356-e52d-44a1-aa8a-96252fd9cc98 on hv-cinder-75996 Feb 17 03:30:15.147394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-8a4a492d-e8f8-4f91-a758-2d5828b2c7a1 req-31647878-d441-4204-83c4-6d9f5fd3b36d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039133 Feb 17 03:30:15.148294 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 341/640] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:30:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:30:15.177255 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3c135776-7191-4424-8e6e-274cc0b17797 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:15.177922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3c135776-7191-4424-8e6e-274cc0b17797 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:15.185925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c135776-7191-4424-8e6e-274cc0b17797 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:15.186706 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c135776-7191-4424-8e6e-274cc0b17797 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:15.187617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c135776-7191-4424-8e6e-274cc0b17797 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:15.188038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c135776-7191-4424-8e6e-274cc0b17797 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:15.349102 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3c135776-7191-4424-8e6e-274cc0b17797 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:15.361532 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3c135776-7191-4424-8e6e-274cc0b17797 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 200 len: 1303 microversion: 2.1 time: 0.188211 Feb 17 03:30:15.363001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 300/641] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:15 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 1303 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:15.645302 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a2bf46be-1c3c-4284-a01c-1216769675ce tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:15.646055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a2bf46be-1c3c-4284-a01c-1216769675ce tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:15.654529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2bf46be-1c3c-4284-a01c-1216769675ce tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:15.655032 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2bf46be-1c3c-4284-a01c-1216769675ce tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:15.655904 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2bf46be-1c3c-4284-a01c-1216769675ce tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:15.656383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2bf46be-1c3c-4284-a01c-1216769675ce tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:15.840418 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ec2cedbf-3e0c-408b-bc3e-db48804d7901 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:15.841808 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ec2cedbf-3e0c-408b-bc3e-db48804d7901 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:15.852491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ec2cedbf-3e0c-408b-bc3e-db48804d7901 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:15.854270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ec2cedbf-3e0c-408b-bc3e-db48804d7901 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:15.855417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ec2cedbf-3e0c-408b-bc3e-db48804d7901 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:15.856160 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ec2cedbf-3e0c-408b-bc3e-db48804d7901 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:16.418139 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a2bf46be-1c3c-4284-a01c-1216769675ce tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:16.428476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a2bf46be-1c3c-4284-a01c-1216769675ce tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:16.430030 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a2bf46be-1c3c-4284-a01c-1216769675ce tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:16.431794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a2bf46be-1c3c-4284-a01c-1216769675ce tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.790522 Feb 17 03:30:16.444041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 342/642] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:15 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:16.444041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6037da4b-f442-4f3e-9f43-d9b87055a379 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:16.444041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6037da4b-f442-4f3e-9f43-d9b87055a379 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:16.445598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6037da4b-f442-4f3e-9f43-d9b87055a379 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:16.446328 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6037da4b-f442-4f3e-9f43-d9b87055a379 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:16.448496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6037da4b-f442-4f3e-9f43-d9b87055a379 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:16.448956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ec2cedbf-3e0c-408b-bc3e-db48804d7901 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:16.449422 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6037da4b-f442-4f3e-9f43-d9b87055a379 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:16.461477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ec2cedbf-3e0c-408b-bc3e-db48804d7901 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1724 microversion: 2.1 time: 0.624558 Feb 17 03:30:16.478140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 301/643] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:15 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1724 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:16.478140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4c0cd9ce-4b52-4a10-85bd-1a54786f0e1a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:16.478140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4c0cd9ce-4b52-4a10-85bd-1a54786f0e1a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: ed401356-e52d-44a1-aa8a-96252fd9cc98] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:16.499121 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4c0cd9ce-4b52-4a10-85bd-1a54786f0e1a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:16.500019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4c0cd9ce-4b52-4a10-85bd-1a54786f0e1a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:16.501235 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4c0cd9ce-4b52-4a10-85bd-1a54786f0e1a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:16.501936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4c0cd9ce-4b52-4a10-85bd-1a54786f0e1a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:16.566334 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-4c0cd9ce-4b52-4a10-85bd-1a54786f0e1a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] HTTP exception thrown: Instance ed401356-e52d-44a1-aa8a-96252fd9cc98 could not be found. Feb 17 03:30:16.567155 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4c0cd9ce-4b52-4a10-85bd-1a54786f0e1a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Returning 404 to user: Instance ed401356-e52d-44a1-aa8a-96252fd9cc98 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:30:16.568095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4c0cd9ce-4b52-4a10-85bd-1a54786f0e1a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98" status: 404 len: 111 microversion: 2.1 time: 0.098688 Feb 17 03:30:16.568724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 302/644] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:16 2021] GET /compute/v2.1/servers/ed401356-e52d-44a1-aa8a-96252fd9cc98 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:30:16.577143 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ab435b98-6c7b-43dc-afab-f59e59a280a6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:16.577692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ab435b98-6c7b-43dc-afab-f59e59a280a6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:16.585595 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ab435b98-6c7b-43dc-afab-f59e59a280a6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:16.586110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ab435b98-6c7b-43dc-afab-f59e59a280a6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:16.587076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ab435b98-6c7b-43dc-afab-f59e59a280a6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:16.588134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ab435b98-6c7b-43dc-afab-f59e59a280a6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:16.656623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ab435b98-6c7b-43dc-afab-f59e59a280a6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Going to try to terminate instance {{(pid=98184) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:30:16.771643 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ab435b98-6c7b-43dc-afab-f59e59a280a6 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "DELETE /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 204 len: 0 microversion: 2.1 time: 0.198077 Feb 17 03:30:16.776664 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 303/645] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:30:16 2021] DELETE /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 03:30:16.780195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-f3abb74b-5d0e-44ad-ba81-8375894df455 req-8a52b46e-dfa1-40e0-b95e-09550a284370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa28415b-6a4c-429a-b1cc-b694089a6af8", "name": "network-vif-unplugged", "status": "completed", "tag": "d44d5eb4-7819-4ef2-ab77-782ff0c9f159"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:16.781908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:30:16.781908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:30:16.790946 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f3abb74b-5d0e-44ad-ba81-8375894df455 req-8a52b46e-dfa1-40e0-b95e-09550a284370 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:16.791484 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f3abb74b-5d0e-44ad-ba81-8375894df455 req-8a52b46e-dfa1-40e0-b95e-09550a284370 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:16.812349 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-f3abb74b-5d0e-44ad-ba81-8375894df455 req-8a52b46e-dfa1-40e0-b95e-09550a284370 service nova] Creating event network-vif-unplugged:d44d5eb4-7819-4ef2-ab77-782ff0c9f159 for instance fa28415b-6a4c-429a-b1cc-b694089a6af8 on hv-cinder-75996 Feb 17 03:30:16.817315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-f3abb74b-5d0e-44ad-ba81-8375894df455 req-8a52b46e-dfa1-40e0-b95e-09550a284370 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043703 Feb 17 03:30:16.817978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 304/646] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:30:16 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:16.823826 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-be0ecae6-ae8a-4e75-8c0a-686da99d160e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:16.824584 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-be0ecae6-ae8a-4e75-8c0a-686da99d160e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:16.832388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be0ecae6-ae8a-4e75-8c0a-686da99d160e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:16.832900 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be0ecae6-ae8a-4e75-8c0a-686da99d160e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:16.833738 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be0ecae6-ae8a-4e75-8c0a-686da99d160e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:16.834229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be0ecae6-ae8a-4e75-8c0a-686da99d160e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:16.843796 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6037da4b-f442-4f3e-9f43-d9b87055a379 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:16.853439 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6037da4b-f442-4f3e-9f43-d9b87055a379 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1507 microversion: 2.1 time: 0.420061 Feb 17 03:30:16.854032 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 343/647] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:16 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:17.053934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-be0ecae6-ae8a-4e75-8c0a-686da99d160e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:17.064388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-be0ecae6-ae8a-4e75-8c0a-686da99d160e tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1514 microversion: 2.1 time: 0.245196 Feb 17 03:30:17.064989 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 305/648] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:16 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:17.450571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-64a8f845-fb58-4fbc-9863-c596403f0741 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:17.451210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-64a8f845-fb58-4fbc-9863-c596403f0741 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:17.459770 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-64a8f845-fb58-4fbc-9863-c596403f0741 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:17.460272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-64a8f845-fb58-4fbc-9863-c596403f0741 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:17.461089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-64a8f845-fb58-4fbc-9863-c596403f0741 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:17.461565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-64a8f845-fb58-4fbc-9863-c596403f0741 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:17.485889 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8637cf93-353c-4e3f-a764-df670d3336bd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:17.486842 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8637cf93-353c-4e3f-a764-df670d3336bd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:17.495854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8637cf93-353c-4e3f-a764-df670d3336bd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:17.496716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8637cf93-353c-4e3f-a764-df670d3336bd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:17.497784 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8637cf93-353c-4e3f-a764-df670d3336bd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:17.498476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8637cf93-353c-4e3f-a764-df670d3336bd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:18.081032 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-64a8f845-fb58-4fbc-9863-c596403f0741 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:18.091427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-64a8f845-fb58-4fbc-9863-c596403f0741 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:18.093017 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-64a8f845-fb58-4fbc-9863-c596403f0741 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:18.094174 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-64a8f845-fb58-4fbc-9863-c596403f0741 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.647816 Feb 17 03:30:18.098249 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 344/649] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:17 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:18.098420 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8637cf93-353c-4e3f-a764-df670d3336bd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:18.099710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1d76e46a-8d46-4cfa-86b8-e0cb71f985f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:18.100515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1d76e46a-8d46-4cfa-86b8-e0cb71f985f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:18.109075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8637cf93-353c-4e3f-a764-df670d3336bd tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1701 microversion: 2.1 time: 0.626961 Feb 17 03:30:18.109200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d76e46a-8d46-4cfa-86b8-e0cb71f985f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:18.109621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d76e46a-8d46-4cfa-86b8-e0cb71f985f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:18.110623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d76e46a-8d46-4cfa-86b8-e0cb71f985f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:18.111279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d76e46a-8d46-4cfa-86b8-e0cb71f985f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:18.120912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 306/650] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:17 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1701 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:18.126375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-eef6b467-0e0c-473e-a260-83c4e8f24555 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:18.127160 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-eef6b467-0e0c-473e-a260-83c4e8f24555 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:18.135621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eef6b467-0e0c-473e-a260-83c4e8f24555 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:18.136124 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eef6b467-0e0c-473e-a260-83c4e8f24555 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:18.137164 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eef6b467-0e0c-473e-a260-83c4e8f24555 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:18.137647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-eef6b467-0e0c-473e-a260-83c4e8f24555 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:18.345593 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1d76e46a-8d46-4cfa-86b8-e0cb71f985f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:18.354473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1d76e46a-8d46-4cfa-86b8-e0cb71f985f2 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1465 microversion: 2.1 time: 0.258721 Feb 17 03:30:18.355063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 345/651] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:18 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1465 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:18.368538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e0075885-046f-4a8e-8f9e-e01ad43aa038 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:18.376150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0075885-046f-4a8e-8f9e-e01ad43aa038 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:18.376649 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0075885-046f-4a8e-8f9e-e01ad43aa038 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:18.448942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e0075885-046f-4a8e-8f9e-e01ad43aa038 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Going to try to start instance {{(pid=98183) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 17 03:30:18.538511 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e0075885-046f-4a8e-8f9e-e01ad43aa038 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 202 len: 0 microversion: 2.1 time: 0.182042 Feb 17 03:30:18.541283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 346/652] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:18 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:18.543988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-eef6b467-0e0c-473e-a260-83c4e8f24555 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:18.549015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-e5330f2c-525b-402e-9488-8b19d48f560d req-785277eb-7018-421c-8e01-5a3dfbb18509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa28415b-6a4c-429a-b1cc-b694089a6af8", "name": "network-vif-deleted", "tag": "d44d5eb4-7819-4ef2-ab77-782ff0c9f159"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:18.550956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:30:18.550956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:30:18.554212 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-eef6b467-0e0c-473e-a260-83c4e8f24555 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1514 microversion: 2.1 time: 0.431749 Feb 17 03:30:18.564767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 307/653] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:18 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1514 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:18.564938 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-e5330f2c-525b-402e-9488-8b19d48f560d req-785277eb-7018-421c-8e01-5a3dfbb18509 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:18.564938 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-e5330f2c-525b-402e-9488-8b19d48f560d req-785277eb-7018-421c-8e01-5a3dfbb18509 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:18.569594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3025a3c3-3ed5-4bba-bbb7-3fd1c52af568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:18.570071 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3025a3c3-3ed5-4bba-bbb7-3fd1c52af568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:18.578937 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3025a3c3-3ed5-4bba-bbb7-3fd1c52af568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:18.579441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3025a3c3-3ed5-4bba-bbb7-3fd1c52af568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:18.580830 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3025a3c3-3ed5-4bba-bbb7-3fd1c52af568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:18.581183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3025a3c3-3ed5-4bba-bbb7-3fd1c52af568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:18.589737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-e5330f2c-525b-402e-9488-8b19d48f560d req-785277eb-7018-421c-8e01-5a3dfbb18509 service nova] Creating event network-vif-deleted:d44d5eb4-7819-4ef2-ab77-782ff0c9f159 for instance fa28415b-6a4c-429a-b1cc-b694089a6af8 on hv-cinder-75996 Feb 17 03:30:18.594905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-e5330f2c-525b-402e-9488-8b19d48f560d req-785277eb-7018-421c-8e01-5a3dfbb18509 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054167 Feb 17 03:30:18.596137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 347/654] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:30:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:18.850466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3025a3c3-3ed5-4bba-bbb7-3fd1c52af568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:18.859961 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3025a3c3-3ed5-4bba-bbb7-3fd1c52af568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1710 microversion: 2.1 time: 0.304072 Feb 17 03:30:18.860556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 308/655] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:18 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1710 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:19.115372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-42cf2776-6a30-48ef-9224-b6412fafceb9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:19.116166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-42cf2776-6a30-48ef-9224-b6412fafceb9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:19.125131 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-42cf2776-6a30-48ef-9224-b6412fafceb9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.125472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-42cf2776-6a30-48ef-9224-b6412fafceb9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.126335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-42cf2776-6a30-48ef-9224-b6412fafceb9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.126821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-42cf2776-6a30-48ef-9224-b6412fafceb9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.373637 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2ffc77b9-0a66-464b-b60d-5496115c80e5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:19.374421 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2ffc77b9-0a66-464b-b60d-5496115c80e5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:19.382985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2ffc77b9-0a66-464b-b60d-5496115c80e5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.384141 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2ffc77b9-0a66-464b-b60d-5496115c80e5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.384647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2ffc77b9-0a66-464b-b60d-5496115c80e5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.385212 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2ffc77b9-0a66-464b-b60d-5496115c80e5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.466182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2ffc77b9-0a66-464b-b60d-5496115c80e5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.466850 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2ffc77b9-0a66-464b-b60d-5496115c80e5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.467430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-2ffc77b9-0a66-464b-b60d-5496115c80e5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lazy-loading 'fault' on Instance uuid fa28415b-6a4c-429a-b1cc-b694089a6af8 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:30:19.676079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2ffc77b9-0a66-464b-b60d-5496115c80e5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:19.684078 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2ffc77b9-0a66-464b-b60d-5496115c80e5 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 200 len: 1311 microversion: 2.1 time: 0.315154 Feb 17 03:30:19.684778 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 309/656] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:19 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 1311 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:19.700678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-39c7efdf-a302-4656-8d55-5016d57eceaf tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:19.701338 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-39c7efdf-a302-4656-8d55-5016d57eceaf tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:19.713869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-39c7efdf-a302-4656-8d55-5016d57eceaf tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.714533 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-39c7efdf-a302-4656-8d55-5016d57eceaf tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.715352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-39c7efdf-a302-4656-8d55-5016d57eceaf tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.716527 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-39c7efdf-a302-4656-8d55-5016d57eceaf tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.763994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-42cf2776-6a30-48ef-9224-b6412fafceb9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:19.776284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-42cf2776-6a30-48ef-9224-b6412fafceb9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:19.780071 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-42cf2776-6a30-48ef-9224-b6412fafceb9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:19.782428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-42cf2776-6a30-48ef-9224-b6412fafceb9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.671678 Feb 17 03:30:19.783559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 348/657] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:19 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:19.878858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a71233ec-e58a-48f9-bb81-1d8e77939271 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:19.879832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a71233ec-e58a-48f9-bb81-1d8e77939271 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:19.894353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a71233ec-e58a-48f9-bb81-1d8e77939271 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.894869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a71233ec-e58a-48f9-bb81-1d8e77939271 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.897818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a71233ec-e58a-48f9-bb81-1d8e77939271 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.897818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a71233ec-e58a-48f9-bb81-1d8e77939271 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.926604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-39c7efdf-a302-4656-8d55-5016d57eceaf tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:19.937148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-39c7efdf-a302-4656-8d55-5016d57eceaf tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 200 len: 1472 microversion: 2.1 time: 0.251101 Feb 17 03:30:19.947752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 310/658] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:19 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 1472 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:20.015188 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-fe2848e3-ac7a-4403-9d4a-7fa56a31f31e req-eefd14c4-966c-4670-aafe-3c49589430aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0acdcb-31cb-4678-aabb-f0ac7feb02a7", "name": "network-vif-deleted", "tag": "813ead8a-622d-4333-899c-033f729a5c55"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:20.017099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:30:20.017099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:30:20.027007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-fe2848e3-ac7a-4403-9d4a-7fa56a31f31e req-eefd14c4-966c-4670-aafe-3c49589430aa service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.027827 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-fe2848e3-ac7a-4403-9d4a-7fa56a31f31e req-eefd14c4-966c-4670-aafe-3c49589430aa service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:20.046156 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-fe2848e3-ac7a-4403-9d4a-7fa56a31f31e req-eefd14c4-966c-4670-aafe-3c49589430aa service nova] Creating event network-vif-deleted:813ead8a-622d-4333-899c-033f729a5c55 for instance df0acdcb-31cb-4678-aabb-f0ac7feb02a7 on hv-cinder-75996 Feb 17 03:30:20.051341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-fe2848e3-ac7a-4403-9d4a-7fa56a31f31e req-eefd14c4-966c-4670-aafe-3c49589430aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042157 Feb 17 03:30:20.053426 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 311/659] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:30:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:30:20.273157 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a71233ec-e58a-48f9-bb81-1d8e77939271 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:20.282887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a71233ec-e58a-48f9-bb81-1d8e77939271 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1710 microversion: 2.1 time: 0.408477 Feb 17 03:30:20.283496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 349/660] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:19 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1710 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:20.703151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a20dc3c4-e6b0-4bc8-a54f-a2306215c1ba tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:20.704046 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a20dc3c4-e6b0-4bc8-a54f-a2306215c1ba tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: fa28415b-6a4c-429a-b1cc-b694089a6af8] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:20.712296 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a20dc3c4-e6b0-4bc8-a54f-a2306215c1ba tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.712829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a20dc3c4-e6b0-4bc8-a54f-a2306215c1ba tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:20.713740 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a20dc3c4-e6b0-4bc8-a54f-a2306215c1ba tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.714303 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a20dc3c4-e6b0-4bc8-a54f-a2306215c1ba tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:20.767759 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-a20dc3c4-e6b0-4bc8-a54f-a2306215c1ba tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] HTTP exception thrown: Instance fa28415b-6a4c-429a-b1cc-b694089a6af8 could not be found. Feb 17 03:30:20.768422 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a20dc3c4-e6b0-4bc8-a54f-a2306215c1ba tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Returning 404 to user: Instance fa28415b-6a4c-429a-b1cc-b694089a6af8 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:30:20.769321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a20dc3c4-e6b0-4bc8-a54f-a2306215c1ba tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8" status: 404 len: 111 microversion: 2.1 time: 0.070751 Feb 17 03:30:20.769936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 312/661] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:20 2021] GET /compute/v2.1/servers/fa28415b-6a4c-429a-b1cc-b694089a6af8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:30:20.779009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-003c735c-f75a-48b7-b619-c8e42416210e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:20.779678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-003c735c-f75a-48b7-b619-c8e42416210e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:20.787677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-003c735c-f75a-48b7-b619-c8e42416210e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.788183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-003c735c-f75a-48b7-b619-c8e42416210e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:20.789009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-003c735c-f75a-48b7-b619-c8e42416210e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.789498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-003c735c-f75a-48b7-b619-c8e42416210e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:20.801455 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9e426e91-4d17-4aae-a75a-a1748eb45642 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:20.802141 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9e426e91-4d17-4aae-a75a-a1748eb45642 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:20.810107 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e426e91-4d17-4aae-a75a-a1748eb45642 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.810609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e426e91-4d17-4aae-a75a-a1748eb45642 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:20.811438 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e426e91-4d17-4aae-a75a-a1748eb45642 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.811956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e426e91-4d17-4aae-a75a-a1748eb45642 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:20.861286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-003c735c-f75a-48b7-b619-c8e42416210e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Going to try to terminate instance {{(pid=98183) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:30:20.991017 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-003c735c-f75a-48b7-b619-c8e42416210e tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 204 len: 0 microversion: 2.1 time: 0.215885 Feb 17 03:30:20.994826 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 350/662] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:30:20 2021] DELETE /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:30:21.002322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cdb2aabb-080a-4812-bc09-b40c3438502b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:21.003093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cdb2aabb-080a-4812-bc09-b40c3438502b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: df0acdcb-31cb-4678-aabb-f0ac7feb02a7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:21.010933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cdb2aabb-080a-4812-bc09-b40c3438502b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:21.011450 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cdb2aabb-080a-4812-bc09-b40c3438502b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:21.012303 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cdb2aabb-080a-4812-bc09-b40c3438502b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:21.012983 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cdb2aabb-080a-4812-bc09-b40c3438502b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:21.042057 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9e426e91-4d17-4aae-a75a-a1748eb45642 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:21.063337 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9e426e91-4d17-4aae-a75a-a1748eb45642 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:21.065006 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9e426e91-4d17-4aae-a75a-a1748eb45642 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:21.066187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9e426e91-4d17-4aae-a75a-a1748eb45642 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.268800 Feb 17 03:30:21.066785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 313/663] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:20 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:30:21.070981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-cdb2aabb-080a-4812-bc09-b40c3438502b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] HTTP exception thrown: Instance df0acdcb-31cb-4678-aabb-f0ac7feb02a7 could not be found. Feb 17 03:30:21.071703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cdb2aabb-080a-4812-bc09-b40c3438502b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Returning 404 to user: Instance df0acdcb-31cb-4678-aabb-f0ac7feb02a7 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:30:21.071838 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d052709c-3e00-430c-a8a4-b749f820abf4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:21.072371 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d052709c-3e00-430c-a8a4-b749f820abf4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:21.072613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cdb2aabb-080a-4812-bc09-b40c3438502b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7" status: 404 len: 111 microversion: 2.1 time: 0.074883 Feb 17 03:30:21.073311 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 351/664] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:20 2021] GET /compute/v2.1/servers/df0acdcb-31cb-4678-aabb-f0ac7feb02a7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:30:21.080728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d052709c-3e00-430c-a8a4-b749f820abf4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:21.081378 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d052709c-3e00-430c-a8a4-b749f820abf4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:21.082540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d052709c-3e00-430c-a8a4-b749f820abf4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:21.083103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d052709c-3e00-430c-a8a4-b749f820abf4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:21.301489 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4023badf-2552-4fd8-9ee2-a7b6060542a0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:21.302303 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4023badf-2552-4fd8-9ee2-a7b6060542a0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:21.310377 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4023badf-2552-4fd8-9ee2-a7b6060542a0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:21.311012 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4023badf-2552-4fd8-9ee2-a7b6060542a0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:21.312000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4023badf-2552-4fd8-9ee2-a7b6060542a0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:21.312675 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4023badf-2552-4fd8-9ee2-a7b6060542a0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:21.334697 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d052709c-3e00-430c-a8a4-b749f820abf4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:21.344731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d052709c-3e00-430c-a8a4-b749f820abf4 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.276889 Feb 17 03:30:21.345459 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 314/665] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:21 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:21.537491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4023badf-2552-4fd8-9ee2-a7b6060542a0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:21.547336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4023badf-2552-4fd8-9ee2-a7b6060542a0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1710 microversion: 2.1 time: 0.249948 Feb 17 03:30:21.547972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 352/666] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:21 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1710 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:22.087681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8c518431-cd13-4faa-a693-5a90e8d5d9b7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:22.088407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8c518431-cd13-4faa-a693-5a90e8d5d9b7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:22.098135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8c518431-cd13-4faa-a693-5a90e8d5d9b7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:22.098739 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8c518431-cd13-4faa-a693-5a90e8d5d9b7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.099933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8c518431-cd13-4faa-a693-5a90e8d5d9b7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:22.100626 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8c518431-cd13-4faa-a693-5a90e8d5d9b7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.326913 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8c518431-cd13-4faa-a693-5a90e8d5d9b7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:22.331949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3c3f9210-2f0b-4773-8f63-5e35f6d07088 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:22.332497 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3c3f9210-2f0b-4773-8f63-5e35f6d07088 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:22.343838 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8c518431-cd13-4faa-a693-5a90e8d5d9b7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:22.346820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8c518431-cd13-4faa-a693-5a90e8d5d9b7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:22.348403 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c3f9210-2f0b-4773-8f63-5e35f6d07088 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:22.348844 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8c518431-cd13-4faa-a693-5a90e8d5d9b7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.266630 Feb 17 03:30:22.348975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c3f9210-2f0b-4773-8f63-5e35f6d07088 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.349412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 315/667] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:22 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:22.352023 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c3f9210-2f0b-4773-8f63-5e35f6d07088 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:22.352652 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c3f9210-2f0b-4773-8f63-5e35f6d07088 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.364143 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bb9be479-1371-4348-8a8e-945011152267 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:22.364844 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bb9be479-1371-4348-8a8e-945011152267 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:22.372711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb9be479-1371-4348-8a8e-945011152267 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:22.373213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb9be479-1371-4348-8a8e-945011152267 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.374042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb9be479-1371-4348-8a8e-945011152267 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:22.374527 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb9be479-1371-4348-8a8e-945011152267 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.420225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3c3f9210-2f0b-4773-8f63-5e35f6d07088 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Going to try to terminate instance {{(pid=98183) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:30:22.546177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3c3f9210-2f0b-4773-8f63-5e35f6d07088 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 204 len: 0 microversion: 2.1 time: 0.217887 Feb 17 03:30:22.546892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 353/668] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:30:22 2021] DELETE /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:30:22.555825 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a260fa75-c7af-40ad-911e-38184805819a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:22.556795 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a260fa75-c7af-40ad-911e-38184805819a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:22.567198 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a260fa75-c7af-40ad-911e-38184805819a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:22.572199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a260fa75-c7af-40ad-911e-38184805819a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.573148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a260fa75-c7af-40ad-911e-38184805819a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:22.573717 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a260fa75-c7af-40ad-911e-38184805819a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.614817 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bb9be479-1371-4348-8a8e-945011152267 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:22.623725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bb9be479-1371-4348-8a8e-945011152267 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.264128 Feb 17 03:30:22.624676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 316/669] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:22 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:22.639353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3141df9a-302d-4f80-b86f-e7d22930bda6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:22.640182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3141df9a-302d-4f80-b86f-e7d22930bda6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:22.648016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3141df9a-302d-4f80-b86f-e7d22930bda6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:22.648641 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3141df9a-302d-4f80-b86f-e7d22930bda6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.649585 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3141df9a-302d-4f80-b86f-e7d22930bda6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:22.650703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3141df9a-302d-4f80-b86f-e7d22930bda6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.873513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a260fa75-c7af-40ad-911e-38184805819a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:22.882909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a260fa75-c7af-40ad-911e-38184805819a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1513 microversion: 2.1 time: 0.331457 Feb 17 03:30:22.883542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 354/670] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:22 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1513 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:22.922794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3141df9a-302d-4f80-b86f-e7d22930bda6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:22.932330 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3141df9a-302d-4f80-b86f-e7d22930bda6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1710 microversion: 2.1 time: 0.297273 Feb 17 03:30:22.932941 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 317/671] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:22 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1710 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:23.369869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1cf899ed-a310-4431-9874-0320e82b9be2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:23.370501 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1cf899ed-a310-4431-9874-0320e82b9be2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:23.378587 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1cf899ed-a310-4431-9874-0320e82b9be2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:23.379009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1cf899ed-a310-4431-9874-0320e82b9be2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:23.380020 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1cf899ed-a310-4431-9874-0320e82b9be2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:23.380500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1cf899ed-a310-4431-9874-0320e82b9be2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:23.642095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d533f380-f174-43e2-8a94-f8796867841a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:23.642768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d533f380-f174-43e2-8a94-f8796867841a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:23.650591 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d533f380-f174-43e2-8a94-f8796867841a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:23.651153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d533f380-f174-43e2-8a94-f8796867841a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:23.652034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d533f380-f174-43e2-8a94-f8796867841a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:23.652529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d533f380-f174-43e2-8a94-f8796867841a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:23.720625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1cf899ed-a310-4431-9874-0320e82b9be2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:23.732176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1cf899ed-a310-4431-9874-0320e82b9be2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:23.733760 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1cf899ed-a310-4431-9874-0320e82b9be2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:23.735011 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1cf899ed-a310-4431-9874-0320e82b9be2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.369817 Feb 17 03:30:23.735900 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 355/672] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:23 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:23.902625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5910b862-c35a-4beb-89e0-2164e609b533 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:23.914808 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5910b862-c35a-4beb-89e0-2164e609b533 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:23.924480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5910b862-c35a-4beb-89e0-2164e609b533 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:23.925072 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5910b862-c35a-4beb-89e0-2164e609b533 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:23.925984 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5910b862-c35a-4beb-89e0-2164e609b533 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:23.926545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5910b862-c35a-4beb-89e0-2164e609b533 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:24.302970 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d533f380-f174-43e2-8a94-f8796867841a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:24.312810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d533f380-f174-43e2-8a94-f8796867841a tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.674778 Feb 17 03:30:24.323395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 318/673] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:23 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:24.323395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-37d6f9b7-f331-4c0f-aed6-c91b6e8bd7bc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:24.323395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-37d6f9b7-f331-4c0f-aed6-c91b6e8bd7bc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:24.325177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5910b862-c35a-4beb-89e0-2164e609b533 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:24.328195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-37d6f9b7-f331-4c0f-aed6-c91b6e8bd7bc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:24.328775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-37d6f9b7-f331-4c0f-aed6-c91b6e8bd7bc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:24.329899 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-37d6f9b7-f331-4c0f-aed6-c91b6e8bd7bc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:24.330440 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-37d6f9b7-f331-4c0f-aed6-c91b6e8bd7bc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:24.334991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5910b862-c35a-4beb-89e0-2164e609b533 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1513 microversion: 2.1 time: 0.437156 Feb 17 03:30:24.336055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 356/674] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:23 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1513 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:24.564823 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-37d6f9b7-f331-4c0f-aed6-c91b6e8bd7bc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:24.577501 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-37d6f9b7-f331-4c0f-aed6-c91b6e8bd7bc tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1714 microversion: 2.1 time: 0.262548 Feb 17 03:30:24.588079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 319/675] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:24 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1714 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:24.754573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-40944421-1f9d-4a81-84cc-c611304be4ca tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:24.755246 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-40944421-1f9d-4a81-84cc-c611304be4ca tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:24.763660 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40944421-1f9d-4a81-84cc-c611304be4ca tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:24.764162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40944421-1f9d-4a81-84cc-c611304be4ca tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:24.764978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40944421-1f9d-4a81-84cc-c611304be4ca tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:24.765466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40944421-1f9d-4a81-84cc-c611304be4ca tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:25.039744 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-40944421-1f9d-4a81-84cc-c611304be4ca tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:25.058817 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-40944421-1f9d-4a81-84cc-c611304be4ca tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:25.061466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-40944421-1f9d-4a81-84cc-c611304be4ca tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:25.062733 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-40944421-1f9d-4a81-84cc-c611304be4ca tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.312201 Feb 17 03:30:25.063432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 357/676] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:24 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:25.330886 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-43111ab2-c714-4c85-a933-7977703b9cf7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:25.331884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-43111ab2-c714-4c85-a933-7977703b9cf7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:25.342321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-43111ab2-c714-4c85-a933-7977703b9cf7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:25.343061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-43111ab2-c714-4c85-a933-7977703b9cf7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:25.344035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-43111ab2-c714-4c85-a933-7977703b9cf7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:25.344776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-43111ab2-c714-4c85-a933-7977703b9cf7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:25.355219 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0d7de943-4ec4-4da4-b545-699fbfa6f19a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:25.355884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0d7de943-4ec4-4da4-b545-699fbfa6f19a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:25.363912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d7de943-4ec4-4da4-b545-699fbfa6f19a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:25.364594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d7de943-4ec4-4da4-b545-699fbfa6f19a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:25.365565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d7de943-4ec4-4da4-b545-699fbfa6f19a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:25.366215 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0d7de943-4ec4-4da4-b545-699fbfa6f19a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:25.700307 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-43111ab2-c714-4c85-a933-7977703b9cf7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:25.702136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0d7de943-4ec4-4da4-b545-699fbfa6f19a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:25.713413 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0d7de943-4ec4-4da4-b545-699fbfa6f19a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1513 microversion: 2.1 time: 0.362607 Feb 17 03:30:25.714782 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 358/677] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:25 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1513 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:25.715964 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-43111ab2-c714-4c85-a933-7977703b9cf7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.389297 Feb 17 03:30:25.726804 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 320/678] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:25 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:26.083690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-307a11dd-8d3a-446c-a4d1-d88619a98ce4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:26.084501 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-307a11dd-8d3a-446c-a4d1-d88619a98ce4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:26.092773 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-307a11dd-8d3a-446c-a4d1-d88619a98ce4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:26.093426 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-307a11dd-8d3a-446c-a4d1-d88619a98ce4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:26.094392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-307a11dd-8d3a-446c-a4d1-d88619a98ce4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:26.094973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-307a11dd-8d3a-446c-a4d1-d88619a98ce4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:26.439064 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-307a11dd-8d3a-446c-a4d1-d88619a98ce4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:26.449559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-307a11dd-8d3a-446c-a4d1-d88619a98ce4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:26.451282 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-307a11dd-8d3a-446c-a4d1-d88619a98ce4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:26.452703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-307a11dd-8d3a-446c-a4d1-d88619a98ce4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.374131 Feb 17 03:30:26.453577 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 359/679] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:26 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:26.732792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2d338abd-cb2b-406a-9a41-53587c5526f5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:26.738321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-858b4473-3559-485e-9ad9-1290226d148b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:26.738971 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-858b4473-3559-485e-9ad9-1290226d148b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:26.744688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2d338abd-cb2b-406a-9a41-53587c5526f5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:26.747559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-858b4473-3559-485e-9ad9-1290226d148b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:26.748147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-858b4473-3559-485e-9ad9-1290226d148b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:26.749272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-858b4473-3559-485e-9ad9-1290226d148b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:26.749480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-858b4473-3559-485e-9ad9-1290226d148b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:26.752757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d338abd-cb2b-406a-9a41-53587c5526f5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:26.753262 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d338abd-cb2b-406a-9a41-53587c5526f5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:26.754140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d338abd-cb2b-406a-9a41-53587c5526f5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:26.754865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d338abd-cb2b-406a-9a41-53587c5526f5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:27.378222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2d338abd-cb2b-406a-9a41-53587c5526f5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:27.387498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-858b4473-3559-485e-9ad9-1290226d148b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:27.393066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2d338abd-cb2b-406a-9a41-53587c5526f5 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1513 microversion: 2.1 time: 0.664051 Feb 17 03:30:27.394040 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 321/680] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:26 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1513 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:27.412779 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-858b4473-3559-485e-9ad9-1290226d148b tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.678276 Feb 17 03:30:27.414345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 360/681] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:26 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:27.472792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d65e9845-3828-435d-bf8b-0f043a7b4434 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:27.473716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d65e9845-3828-435d-bf8b-0f043a7b4434 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:27.483286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d65e9845-3828-435d-bf8b-0f043a7b4434 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:27.483820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d65e9845-3828-435d-bf8b-0f043a7b4434 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:27.484670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d65e9845-3828-435d-bf8b-0f043a7b4434 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:27.485161 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d65e9845-3828-435d-bf8b-0f043a7b4434 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:27.741035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d65e9845-3828-435d-bf8b-0f043a7b4434 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:27.752746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d65e9845-3828-435d-bf8b-0f043a7b4434 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:27.754821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d65e9845-3828-435d-bf8b-0f043a7b4434 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:27.756334 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d65e9845-3828-435d-bf8b-0f043a7b4434 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.287647 Feb 17 03:30:27.756939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 322/682] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:27 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:28.413236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-23156b4c-b8cf-4027-8d8b-b1ee63e56ec8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:28.413868 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-23156b4c-b8cf-4027-8d8b-b1ee63e56ec8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:28.434989 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5469b3d4-f722-4858-8f17-782b97dace74 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:28.435837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5469b3d4-f722-4858-8f17-782b97dace74 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:28.442180 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23156b4c-b8cf-4027-8d8b-b1ee63e56ec8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:28.442679 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23156b4c-b8cf-4027-8d8b-b1ee63e56ec8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:28.443496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23156b4c-b8cf-4027-8d8b-b1ee63e56ec8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:28.453460 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23156b4c-b8cf-4027-8d8b-b1ee63e56ec8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:28.454120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5469b3d4-f722-4858-8f17-782b97dace74 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:28.454789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5469b3d4-f722-4858-8f17-782b97dace74 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:28.458607 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5469b3d4-f722-4858-8f17-782b97dace74 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:28.459270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5469b3d4-f722-4858-8f17-782b97dace74 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:29.081627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-23156b4c-b8cf-4027-8d8b-b1ee63e56ec8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:29.085958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5469b3d4-f722-4858-8f17-782b97dace74 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:29.098797 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5469b3d4-f722-4858-8f17-782b97dace74 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.671544 Feb 17 03:30:29.112948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-23156b4c-b8cf-4027-8d8b-b1ee63e56ec8 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1513 microversion: 2.1 time: 0.704933 Feb 17 03:30:29.127338 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 323/683] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:28 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:29.128205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 361/684] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:28 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1513 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:29.135441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a886e8bd-a2ba-4ec1-a70e-aae98db66e09 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:29.145078 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a886e8bd-a2ba-4ec1-a70e-aae98db66e09 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:29.155011 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a886e8bd-a2ba-4ec1-a70e-aae98db66e09 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:29.160231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a886e8bd-a2ba-4ec1-a70e-aae98db66e09 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:29.161402 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a886e8bd-a2ba-4ec1-a70e-aae98db66e09 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:29.163674 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a886e8bd-a2ba-4ec1-a70e-aae98db66e09 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:29.478701 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a886e8bd-a2ba-4ec1-a70e-aae98db66e09 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:29.489578 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a886e8bd-a2ba-4ec1-a70e-aae98db66e09 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:29.491220 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a886e8bd-a2ba-4ec1-a70e-aae98db66e09 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:29.492660 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a886e8bd-a2ba-4ec1-a70e-aae98db66e09 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.363148 Feb 17 03:30:29.494685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 362/685] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:29 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:30.135129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a90c6a2c-4339-407e-8abe-2c8172e3df5c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:30.135829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a90c6a2c-4339-407e-8abe-2c8172e3df5c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:30.146361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8884e5a3-e52c-4a94-9144-e1f7a2936a69 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:30.151604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8884e5a3-e52c-4a94-9144-e1f7a2936a69 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:30.157004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8884e5a3-e52c-4a94-9144-e1f7a2936a69 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:30.157515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8884e5a3-e52c-4a94-9144-e1f7a2936a69 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:30.158369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8884e5a3-e52c-4a94-9144-e1f7a2936a69 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:30.158860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8884e5a3-e52c-4a94-9144-e1f7a2936a69 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:30.171244 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a90c6a2c-4339-407e-8abe-2c8172e3df5c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:30.171784 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a90c6a2c-4339-407e-8abe-2c8172e3df5c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:30.172648 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a90c6a2c-4339-407e-8abe-2c8172e3df5c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:30.173155 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a90c6a2c-4339-407e-8abe-2c8172e3df5c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:30.546974 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8884e5a3-e52c-4a94-9144-e1f7a2936a69 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:30.556835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8884e5a3-e52c-4a94-9144-e1f7a2936a69 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1513 microversion: 2.1 time: 0.414369 Feb 17 03:30:30.568079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 363/686] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:30 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1513 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:30.578388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-5d81828b-d6cd-43ab-bfd6-f0e9dc11945a req-2f66f463-62d6-4aa4-9b21-524118b919f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89d14a3-493e-413a-918e-fd2de544e689", "name": "network-vif-plugged", "status": "completed", "tag": "8e645981-866a-495c-83c8-d0e1206a99d1"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:30.578388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:30:30.578388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:30:30.583737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-5d81828b-d6cd-43ab-bfd6-f0e9dc11945a req-2f66f463-62d6-4aa4-9b21-524118b919f6 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:30.584066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-5d81828b-d6cd-43ab-bfd6-f0e9dc11945a req-2f66f463-62d6-4aa4-9b21-524118b919f6 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:30.608493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-5d81828b-d6cd-43ab-bfd6-f0e9dc11945a req-2f66f463-62d6-4aa4-9b21-524118b919f6 service nova] Creating event network-vif-plugged:8e645981-866a-495c-83c8-d0e1206a99d1 for instance a89d14a3-493e-413a-918e-fd2de544e689 on hv-cinder-75996 Feb 17 03:30:30.614234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-5d81828b-d6cd-43ab-bfd6-f0e9dc11945a req-2f66f463-62d6-4aa4-9b21-524118b919f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044815 Feb 17 03:30:30.614910 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 364/687] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:30:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:30.624817 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-067d8164-ae18-45ed-be59-592c90b4edc2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:30.625969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-067d8164-ae18-45ed-be59-592c90b4edc2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:30.634932 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a90c6a2c-4339-407e-8abe-2c8172e3df5c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:30.638526 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-067d8164-ae18-45ed-be59-592c90b4edc2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:30.639030 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-067d8164-ae18-45ed-be59-592c90b4edc2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:30.639893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-067d8164-ae18-45ed-be59-592c90b4edc2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:30.640364 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-067d8164-ae18-45ed-be59-592c90b4edc2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:30.655586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a90c6a2c-4339-407e-8abe-2c8172e3df5c tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.524970 Feb 17 03:30:30.657841 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 324/688] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:30 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:30.891354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-accce018-dc5e-4a76-a258-c37cf697ed30 req-1ee42b4e-892a-4b65-8170-6a476a128e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d0cd30-d2db-45c4-b0f0-35a3d1397131", "name": "network-vif-deleted", "tag": "20bebd7e-f117-4b32-875f-9094449d119c"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:30.893422 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:30:30.893422 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:30:30.903322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-accce018-dc5e-4a76-a258-c37cf697ed30 req-1ee42b4e-892a-4b65-8170-6a476a128e07 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:30.904091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-accce018-dc5e-4a76-a258-c37cf697ed30 req-1ee42b4e-892a-4b65-8170-6a476a128e07 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:30.913341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-067d8164-ae18-45ed-be59-592c90b4edc2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:30.922902 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-accce018-dc5e-4a76-a258-c37cf697ed30 req-1ee42b4e-892a-4b65-8170-6a476a128e07 service nova] Creating event network-vif-deleted:20bebd7e-f117-4b32-875f-9094449d119c for instance b1d0cd30-d2db-45c4-b0f0-35a3d1397131 on hv-cinder-75996 Feb 17 03:30:30.926879 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-067d8164-ae18-45ed-be59-592c90b4edc2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:30.928613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-accce018-dc5e-4a76-a258-c37cf697ed30 req-1ee42b4e-892a-4b65-8170-6a476a128e07 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041092 Feb 17 03:30:30.928970 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-067d8164-ae18-45ed-be59-592c90b4edc2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:30.929932 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 325/689] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:30:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:30.930277 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-067d8164-ae18-45ed-be59-592c90b4edc2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.314092 Feb 17 03:30:30.931026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 365/690] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:30 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:31.586247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a8c821f9-2f0f-47ab-bb9e-7260bb3c0030 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:31.587558 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a8c821f9-2f0f-47ab-bb9e-7260bb3c0030 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:31.595564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a8c821f9-2f0f-47ab-bb9e-7260bb3c0030 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:31.596081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a8c821f9-2f0f-47ab-bb9e-7260bb3c0030 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:31.596913 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a8c821f9-2f0f-47ab-bb9e-7260bb3c0030 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:31.597406 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a8c821f9-2f0f-47ab-bb9e-7260bb3c0030 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:31.676054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-690810b5-f9fd-4aa1-8bd1-219ed116cf49 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:31.676933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-690810b5-f9fd-4aa1-8bd1-219ed116cf49 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:31.689014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-690810b5-f9fd-4aa1-8bd1-219ed116cf49 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:31.689777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-690810b5-f9fd-4aa1-8bd1-219ed116cf49 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:31.690824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-690810b5-f9fd-4aa1-8bd1-219ed116cf49 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:31.691721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-690810b5-f9fd-4aa1-8bd1-219ed116cf49 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:31.745819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a8c821f9-2f0f-47ab-bb9e-7260bb3c0030 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:31.755971 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a8c821f9-2f0f-47ab-bb9e-7260bb3c0030 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1471 microversion: 2.1 time: 0.174185 Feb 17 03:30:31.762714 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 326/691] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:31 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:31.948022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-690810b5-f9fd-4aa1-8bd1-219ed116cf49 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:31.950875 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-28963358-4828-4252-b0e6-2717dc0ca00e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:31.951819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-28963358-4828-4252-b0e6-2717dc0ca00e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:31.956892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-690810b5-f9fd-4aa1-8bd1-219ed116cf49 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.284954 Feb 17 03:30:31.957486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 366/692] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:31 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:31.960423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-28963358-4828-4252-b0e6-2717dc0ca00e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:31.961085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-28963358-4828-4252-b0e6-2717dc0ca00e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:31.962616 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-28963358-4828-4252-b0e6-2717dc0ca00e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:31.963236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-28963358-4828-4252-b0e6-2717dc0ca00e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:32.199039 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-28963358-4828-4252-b0e6-2717dc0ca00e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:32.222326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-28963358-4828-4252-b0e6-2717dc0ca00e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:32.236340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-28963358-4828-4252-b0e6-2717dc0ca00e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:32.237599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-28963358-4828-4252-b0e6-2717dc0ca00e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.291518 Feb 17 03:30:32.238189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 327/693] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:31 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:32.780512 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7e140cc2-1630-447c-92bb-e9a7fe6e922a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:32.781172 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7e140cc2-1630-447c-92bb-e9a7fe6e922a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:32.788974 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7e140cc2-1630-447c-92bb-e9a7fe6e922a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:32.789472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7e140cc2-1630-447c-92bb-e9a7fe6e922a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:32.790958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7e140cc2-1630-447c-92bb-e9a7fe6e922a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:32.791591 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7e140cc2-1630-447c-92bb-e9a7fe6e922a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:32.868463 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7e140cc2-1630-447c-92bb-e9a7fe6e922a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:32.868969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7e140cc2-1630-447c-92bb-e9a7fe6e922a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:32.869476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-7e140cc2-1630-447c-92bb-e9a7fe6e922a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lazy-loading 'fault' on Instance uuid b1d0cd30-d2db-45c4-b0f0-35a3d1397131 {{(pid=98183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:30:32.932994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7e140cc2-1630-447c-92bb-e9a7fe6e922a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:32.941996 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7e140cc2-1630-447c-92bb-e9a7fe6e922a tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1307 microversion: 2.1 time: 0.165350 Feb 17 03:30:32.942591 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 367/694] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:32 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1307 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:32.974889 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-87b31dca-f212-4b19-9c12-43f4b18803cd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:32.975817 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-87b31dca-f212-4b19-9c12-43f4b18803cd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:32.984426 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-87b31dca-f212-4b19-9c12-43f4b18803cd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:32.984934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-87b31dca-f212-4b19-9c12-43f4b18803cd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:32.985776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-87b31dca-f212-4b19-9c12-43f4b18803cd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:32.986272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-87b31dca-f212-4b19-9c12-43f4b18803cd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:33.259927 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-019101c9-e8c3-42d5-8a6b-167ccccf9f7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:33.260562 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-019101c9-e8c3-42d5-8a6b-167ccccf9f7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:33.268497 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-87b31dca-f212-4b19-9c12-43f4b18803cd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:33.273972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-019101c9-e8c3-42d5-8a6b-167ccccf9f7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:33.274502 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-019101c9-e8c3-42d5-8a6b-167ccccf9f7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:33.280468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-87b31dca-f212-4b19-9c12-43f4b18803cd tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.309796 Feb 17 03:30:33.283994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-019101c9-e8c3-42d5-8a6b-167ccccf9f7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:33.284493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-019101c9-e8c3-42d5-8a6b-167ccccf9f7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:33.286897 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 328/695] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:32 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:33.960494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2aeb4f99-1a12-4ead-9a4b-7f9b46e6b1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:33.961887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2aeb4f99-1a12-4ead-9a4b-7f9b46e6b1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:33.983344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2aeb4f99-1a12-4ead-9a4b-7f9b46e6b1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:33.983881 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2aeb4f99-1a12-4ead-9a4b-7f9b46e6b1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:33.984914 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2aeb4f99-1a12-4ead-9a4b-7f9b46e6b1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:33.985556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2aeb4f99-1a12-4ead-9a4b-7f9b46e6b1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:34.074017 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-019101c9-e8c3-42d5-8a6b-167ccccf9f7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:34.074975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2aeb4f99-1a12-4ead-9a4b-7f9b46e6b1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:34.075805 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2aeb4f99-1a12-4ead-9a4b-7f9b46e6b1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:34.076636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-2aeb4f99-1a12-4ead-9a4b-7f9b46e6b1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lazy-loading 'fault' on Instance uuid b1d0cd30-d2db-45c4-b0f0-35a3d1397131 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:30:34.088747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-019101c9-e8c3-42d5-8a6b-167ccccf9f7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:34.090702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-019101c9-e8c3-42d5-8a6b-167ccccf9f7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:34.092238 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-019101c9-e8c3-42d5-8a6b-167ccccf9f7f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.837034 Feb 17 03:30:34.095570 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 368/696] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:33 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:34.160665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2aeb4f99-1a12-4ead-9a4b-7f9b46e6b1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a15644050d496c9d4a641eb5f8f088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ade3597251b451eb7a31a1c95528adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:34.170648 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2aeb4f99-1a12-4ead-9a4b-7f9b46e6b1b4 tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 200 len: 1307 microversion: 2.1 time: 0.214285 Feb 17 03:30:34.180458 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 329/697] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:33 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 1307 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:34.304696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e16ae791-699a-49a4-8614-84e910033395 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:34.305642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e16ae791-699a-49a4-8614-84e910033395 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:34.314481 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e16ae791-699a-49a4-8614-84e910033395 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:34.315286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e16ae791-699a-49a4-8614-84e910033395 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:34.316200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e16ae791-699a-49a4-8614-84e910033395 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:34.317041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e16ae791-699a-49a4-8614-84e910033395 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:34.644141 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e16ae791-699a-49a4-8614-84e910033395 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:34.654750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e16ae791-699a-49a4-8614-84e910033395 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 0.354165 Feb 17 03:30:34.655565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 369/698] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:34 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:35.117487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f5ca51f2-17e8-4205-816e-b2929d0e2862 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:35.118278 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f5ca51f2-17e8-4205-816e-b2929d0e2862 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:35.133087 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f5ca51f2-17e8-4205-816e-b2929d0e2862 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:35.133880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f5ca51f2-17e8-4205-816e-b2929d0e2862 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:35.140568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f5ca51f2-17e8-4205-816e-b2929d0e2862 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:35.141219 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f5ca51f2-17e8-4205-816e-b2929d0e2862 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:35.189460 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4159e88f-29f1-463c-a6b6-9eda3ac1f95b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:35.190516 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4159e88f-29f1-463c-a6b6-9eda3ac1f95b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] [instance: b1d0cd30-d2db-45c4-b0f0-35a3d1397131] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:35.235406 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4159e88f-29f1-463c-a6b6-9eda3ac1f95b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:35.237692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4159e88f-29f1-463c-a6b6-9eda3ac1f95b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:35.238589 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4159e88f-29f1-463c-a6b6-9eda3ac1f95b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:35.239086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4159e88f-29f1-463c-a6b6-9eda3ac1f95b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:35.349807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-4159e88f-29f1-463c-a6b6-9eda3ac1f95b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] HTTP exception thrown: Instance b1d0cd30-d2db-45c4-b0f0-35a3d1397131 could not be found. Feb 17 03:30:35.350559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4159e88f-29f1-463c-a6b6-9eda3ac1f95b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] Returning 404 to user: Instance b1d0cd30-d2db-45c4-b0f0-35a3d1397131 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:30:35.351636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4159e88f-29f1-463c-a6b6-9eda3ac1f95b tempest-AttachVolumeNegativeTest-1980725982 tempest-AttachVolumeNegativeTest-1980725982-project] 10.222.0.46 "GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131" status: 404 len: 111 microversion: 2.1 time: 0.166140 Feb 17 03:30:35.353240 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 370/699] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:35 2021] GET /compute/v2.1/servers/b1d0cd30-d2db-45c4-b0f0-35a3d1397131 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:30:35.677838 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3836d804-23c1-4079-8804-e4d9ee284390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:35.682114 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3836d804-23c1-4079-8804-e4d9ee284390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:35.695755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3836d804-23c1-4079-8804-e4d9ee284390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:35.699764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3836d804-23c1-4079-8804-e4d9ee284390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:35.703902 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3836d804-23c1-4079-8804-e4d9ee284390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:35.706658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3836d804-23c1-4079-8804-e4d9ee284390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:35.969145 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f5ca51f2-17e8-4205-816e-b2929d0e2862 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:35.996924 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f5ca51f2-17e8-4205-816e-b2929d0e2862 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:36.006507 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f5ca51f2-17e8-4205-816e-b2929d0e2862 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:36.008018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f5ca51f2-17e8-4205-816e-b2929d0e2862 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1807 microversion: 2.20 time: 0.897955 Feb 17 03:30:36.020025 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 330/700] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:35 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1807 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:36.559894 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-e6d30839-60db-4b33-ab4f-6388d620b4ac req-cc823500-9e8e-4ec1-980c-2c13a50d2a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec09d11-1456-48e6-9b4a-cbb0c7775f78", "name": "network-vif-deleted", "tag": "c9ca62c0-10ef-4ead-9a9e-530134fbf939"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:36.563369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:30:36.563369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:30:36.574601 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-e6d30839-60db-4b33-ab4f-6388d620b4ac req-cc823500-9e8e-4ec1-980c-2c13a50d2a8d service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:36.578269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-e6d30839-60db-4b33-ab4f-6388d620b4ac req-cc823500-9e8e-4ec1-980c-2c13a50d2a8d service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:36.601921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-e6d30839-60db-4b33-ab4f-6388d620b4ac req-cc823500-9e8e-4ec1-980c-2c13a50d2a8d service nova] Creating event network-vif-deleted:c9ca62c0-10ef-4ead-9a9e-530134fbf939 for instance 6ec09d11-1456-48e6-9b4a-cbb0c7775f78 on hv-cinder-75996 Feb 17 03:30:36.608681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-e6d30839-60db-4b33-ab4f-6388d620b4ac req-cc823500-9e8e-4ec1-980c-2c13a50d2a8d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053368 Feb 17 03:30:36.610193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 331/701] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:30:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:30:36.763330 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3836d804-23c1-4079-8804-e4d9ee284390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6816ad0cd5f846ef8a759f5a2ded11c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a5692210d54de3b217536dd49aa377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:36.781971 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3836d804-23c1-4079-8804-e4d9ee284390 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 200 len: 1520 microversion: 2.1 time: 1.109466 Feb 17 03:30:36.783086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 371/702] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:35 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 1520 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:37.032545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-25af7920-4596-482b-be69-c2cfa4b0e233 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:37.033229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-25af7920-4596-482b-be69-c2cfa4b0e233 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:37.043139 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25af7920-4596-482b-be69-c2cfa4b0e233 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:37.043673 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25af7920-4596-482b-be69-c2cfa4b0e233 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:37.044689 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25af7920-4596-482b-be69-c2cfa4b0e233 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:37.045180 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25af7920-4596-482b-be69-c2cfa4b0e233 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:37.437763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-763aa686-d3f1-4168-bc05-5b3239cb542e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:37.438295 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-763aa686-d3f1-4168-bc05-5b3239cb542e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:37.453283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-763aa686-d3f1-4168-bc05-5b3239cb542e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:37.453704 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-763aa686-d3f1-4168-bc05-5b3239cb542e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:37.454575 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-763aa686-d3f1-4168-bc05-5b3239cb542e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:37.455060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-763aa686-d3f1-4168-bc05-5b3239cb542e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:37.522677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-25af7920-4596-482b-be69-c2cfa4b0e233 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:37.545948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-25af7920-4596-482b-be69-c2cfa4b0e233 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:37.551593 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-25af7920-4596-482b-be69-c2cfa4b0e233 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:37.553022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-25af7920-4596-482b-be69-c2cfa4b0e233 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1794 microversion: 2.20 time: 0.525311 Feb 17 03:30:37.554186 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 332/703] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:30:37 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1794 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:30:37.721630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-763aa686-d3f1-4168-bc05-5b3239cb542e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lazy-loading 'services' on Instance uuid eb66928f-13b6-4bf2-909c-6c9b985bf446 {{(pid=98183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:30:37.801411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f2f8c4cc-61db-4802-9ede-03adde1a10c7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:37.802275 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f2f8c4cc-61db-4802-9ede-03adde1a10c7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] [instance: 6ec09d11-1456-48e6-9b4a-cbb0c7775f78] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:37.815550 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f2f8c4cc-61db-4802-9ede-03adde1a10c7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:37.818474 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f2f8c4cc-61db-4802-9ede-03adde1a10c7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:37.819503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f2f8c4cc-61db-4802-9ede-03adde1a10c7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:37.824096 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f2f8c4cc-61db-4802-9ede-03adde1a10c7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:37.892196 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-763aa686-d3f1-4168-bc05-5b3239cb542e tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446/os-volume_attachments/f8af21aa-40a3-4277-ac34-079d86160f44" status: 202 len: 0 microversion: 2.1 time: 0.458166 Feb 17 03:30:37.893601 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 372/704] 10.222.0.46 () {58 vars in 1406 bytes} [Wed Feb 17 03:30:37 2021] DELETE /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446/os-volume_attachments/f8af21aa-40a3-4277-ac34-079d86160f44 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:37.932742 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-f2f8c4cc-61db-4802-9ede-03adde1a10c7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] HTTP exception thrown: Instance 6ec09d11-1456-48e6-9b4a-cbb0c7775f78 could not be found. Feb 17 03:30:37.958630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f2f8c4cc-61db-4802-9ede-03adde1a10c7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] Returning 404 to user: Instance 6ec09d11-1456-48e6-9b4a-cbb0c7775f78 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:30:37.959750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f2f8c4cc-61db-4802-9ede-03adde1a10c7 tempest-ServerRescueNegativeTestJSON-2012574549 tempest-ServerRescueNegativeTestJSON-2012574549-project] 10.222.0.46 "GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78" status: 404 len: 111 microversion: 2.1 time: 0.162337 Feb 17 03:30:37.961191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 333/705] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:37 2021] GET /compute/v2.1/servers/6ec09d11-1456-48e6-9b4a-cbb0c7775f78 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:30:39.211793 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e3fbd7cd-68f5-466d-84a3-b2b9ca36e838 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:39.213686 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e3fbd7cd-68f5-466d-84a3-b2b9ca36e838 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:39.238765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e3fbd7cd-68f5-466d-84a3-b2b9ca36e838 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:39.239270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e3fbd7cd-68f5-466d-84a3-b2b9ca36e838 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:39.240212 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e3fbd7cd-68f5-466d-84a3-b2b9ca36e838 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:39.240703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e3fbd7cd-68f5-466d-84a3-b2b9ca36e838 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:39.358496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e3fbd7cd-68f5-466d-84a3-b2b9ca36e838 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Going to try to terminate instance {{(pid=98183) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:30:39.563269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e3fbd7cd-68f5-466d-84a3-b2b9ca36e838 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 204 len: 0 microversion: 2.1 time: 0.361576 Feb 17 03:30:39.565076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 373/706] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:30:39 2021] DELETE /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:30:39.574246 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-679bf0ad-969a-4f82-88bd-58593e73ca54 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:39.575290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-679bf0ad-969a-4f82-88bd-58593e73ca54 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:39.583645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-679bf0ad-969a-4f82-88bd-58593e73ca54 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:39.584397 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-679bf0ad-969a-4f82-88bd-58593e73ca54 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:39.585776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-679bf0ad-969a-4f82-88bd-58593e73ca54 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:39.586429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-679bf0ad-969a-4f82-88bd-58593e73ca54 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:40.357148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-679bf0ad-969a-4f82-88bd-58593e73ca54 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:40.366553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-679bf0ad-969a-4f82-88bd-58593e73ca54 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1513 microversion: 2.1 time: 0.796930 Feb 17 03:30:40.367314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 334/707] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:39 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1513 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:41.386265 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bef9f597-79ef-4bf0-8a9c-75200630ff14 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:41.388206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bef9f597-79ef-4bf0-8a9c-75200630ff14 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:41.398434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bef9f597-79ef-4bf0-8a9c-75200630ff14 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:41.399255 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bef9f597-79ef-4bf0-8a9c-75200630ff14 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:41.400394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bef9f597-79ef-4bf0-8a9c-75200630ff14 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:41.401086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bef9f597-79ef-4bf0-8a9c-75200630ff14 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:42.200240 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bef9f597-79ef-4bf0-8a9c-75200630ff14 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:42.230270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bef9f597-79ef-4bf0-8a9c-75200630ff14 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1513 microversion: 2.1 time: 0.850017 Feb 17 03:30:42.241000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 374/708] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:41 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1513 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:43.260987 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-140df9dc-0a03-41f5-b4f9-b0fbf2200d0d tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:43.263134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-f19d5da5-4021-412d-aa2a-b05d93cee639 req-121899ad-7525-4baf-a32d-5d180aafbdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb66928f-13b6-4bf2-909c-6c9b985bf446", "name": "network-vif-unplugged", "status": "completed", "tag": "82841018-3a77-4f6c-ba00-647e073193cc"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:43.264478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-140df9dc-0a03-41f5-b4f9-b0fbf2200d0d tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:43.269632 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:30:43.269632 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:30:43.299997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f19d5da5-4021-412d-aa2a-b05d93cee639 req-121899ad-7525-4baf-a32d-5d180aafbdf1 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:43.300489 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-140df9dc-0a03-41f5-b4f9-b0fbf2200d0d tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:43.301214 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-140df9dc-0a03-41f5-b4f9-b0fbf2200d0d tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:43.302344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-140df9dc-0a03-41f5-b4f9-b0fbf2200d0d tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:43.303032 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-140df9dc-0a03-41f5-b4f9-b0fbf2200d0d tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:43.303805 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f19d5da5-4021-412d-aa2a-b05d93cee639 req-121899ad-7525-4baf-a32d-5d180aafbdf1 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:43.351654 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-f19d5da5-4021-412d-aa2a-b05d93cee639 req-121899ad-7525-4baf-a32d-5d180aafbdf1 service nova] Creating event network-vif-unplugged:82841018-3a77-4f6c-ba00-647e073193cc for instance eb66928f-13b6-4bf2-909c-6c9b985bf446 on hv-cinder-75996 Feb 17 03:30:43.363656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-f19d5da5-4021-412d-aa2a-b05d93cee639 req-121899ad-7525-4baf-a32d-5d180aafbdf1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109389 Feb 17 03:30:43.364480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 335/709] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:30:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:43.840833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-140df9dc-0a03-41f5-b4f9-b0fbf2200d0d tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:43.853140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-140df9dc-0a03-41f5-b4f9-b0fbf2200d0d tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1513 microversion: 2.1 time: 0.597173 Feb 17 03:30:43.854604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 375/710] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:43 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1513 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:44.874276 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cd8874e8-f36e-4ec6-af06-a5879627b040 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:44.879952 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cd8874e8-f36e-4ec6-af06-a5879627b040 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:44.901179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cd8874e8-f36e-4ec6-af06-a5879627b040 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:44.901689 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cd8874e8-f36e-4ec6-af06-a5879627b040 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:44.902551 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cd8874e8-f36e-4ec6-af06-a5879627b040 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:44.903045 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cd8874e8-f36e-4ec6-af06-a5879627b040 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:45.290754 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-cc92edc2-b064-4502-9d02-db4de6229538 req-d1ab1eec-227f-4073-bcb5-bebd9fe87893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb66928f-13b6-4bf2-909c-6c9b985bf446", "name": "network-vif-deleted", "tag": "82841018-3a77-4f6c-ba00-647e073193cc"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:45.294713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:30:45.294713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:30:45.327566 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-cc92edc2-b064-4502-9d02-db4de6229538 req-d1ab1eec-227f-4073-bcb5-bebd9fe87893 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:45.331270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-cc92edc2-b064-4502-9d02-db4de6229538 req-d1ab1eec-227f-4073-bcb5-bebd9fe87893 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:45.400428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-cc92edc2-b064-4502-9d02-db4de6229538 req-d1ab1eec-227f-4073-bcb5-bebd9fe87893 service nova] Creating event network-vif-deleted:82841018-3a77-4f6c-ba00-647e073193cc for instance eb66928f-13b6-4bf2-909c-6c9b985bf446 on hv-cinder-75996 Feb 17 03:30:45.424526 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-cc92edc2-b064-4502-9d02-db4de6229538 req-d1ab1eec-227f-4073-bcb5-bebd9fe87893 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132410 Feb 17 03:30:45.425230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 376/711] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:30:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:30:45.763589 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cd8874e8-f36e-4ec6-af06-a5879627b040 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84384593523349cd83241278c8e7de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1d7bf87bab45169741a768823d447b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:45.779272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cd8874e8-f36e-4ec6-af06-a5879627b040 tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 200 len: 1471 microversion: 2.1 time: 0.909862 Feb 17 03:30:45.790615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 336/712] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:44 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 1471 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:46.797791 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d8aa290d-6d6d-4584-ac33-42b28ecb755f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:46.798513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d8aa290d-6d6d-4584-ac33-42b28ecb755f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] [instance: eb66928f-13b6-4bf2-909c-6c9b985bf446] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:46.806993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d8aa290d-6d6d-4584-ac33-42b28ecb755f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:46.807837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d8aa290d-6d6d-4584-ac33-42b28ecb755f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:46.808904 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d8aa290d-6d6d-4584-ac33-42b28ecb755f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:46.809597 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d8aa290d-6d6d-4584-ac33-42b28ecb755f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:46.865251 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-d8aa290d-6d6d-4584-ac33-42b28ecb755f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] HTTP exception thrown: Instance eb66928f-13b6-4bf2-909c-6c9b985bf446 could not be found. Feb 17 03:30:46.866716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d8aa290d-6d6d-4584-ac33-42b28ecb755f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] Returning 404 to user: Instance eb66928f-13b6-4bf2-909c-6c9b985bf446 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:30:46.868914 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d8aa290d-6d6d-4584-ac33-42b28ecb755f tempest-VolumesSnapshotTestJSON-1362923283 tempest-VolumesSnapshotTestJSON-1362923283-project] 10.222.0.46 "GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446" status: 404 len: 111 microversion: 2.1 time: 0.074647 Feb 17 03:30:46.869669 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 337/713] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:46 2021] GET /compute/v2.1/servers/eb66928f-13b6-4bf2-909c-6c9b985bf446 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:30:47.045065 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3dcd7bc5-044b-47f8-a8c1-9916a453a015 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Action: 'create', calling method: .version_select at 0x7f012f0479d8>, body: {"keypair": {"name": "tempest-TestShelveInstance-940726939"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:47.078390 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-3dcd7bc5-044b-47f8-a8c1-9916a453a015 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Getting quotas for project 62cc4e74ed8a4799a22ac0af1dfb7c4b. Resources: {'key_pairs'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:30:47.083136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-3dcd7bc5-044b-47f8-a8c1-9916a453a015 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Getting quotas for user 49d147b672c945dfb892ccc616d8f184 and project 62cc4e74ed8a4799a22ac0af1dfb7c4b. Resources: {'key_pairs'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:30:47.467853 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-3dcd7bc5-044b-47f8-a8c1-9916a453a015 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Getting quotas for project 62cc4e74ed8a4799a22ac0af1dfb7c4b. Resources: {'key_pairs'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:30:47.475167 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-3dcd7bc5-044b-47f8-a8c1-9916a453a015 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Getting quotas for user 49d147b672c945dfb892ccc616d8f184 and project 62cc4e74ed8a4799a22ac0af1dfb7c4b. Resources: {'key_pairs'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:30:47.494088 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3dcd7bc5-044b-47f8-a8c1-9916a453a015 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.825839 Feb 17 03:30:47.495182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 377/714] 10.222.0.46 () {60 vars in 1148 bytes} [Wed Feb 17 03:30:46 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:47.506799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bfc7c8cd-92b4-4ab3-95fe-0773481268f2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Action: 'create', calling method: .version_select at 0x7f0133069ea0>, body: {"security_group": {"name": "tempest-TestShelveInstance-15226300", "description": "tempest-TestShelveInstance-15226300 description"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:47.841789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bfc7c8cd-92b4-4ab3-95fe-0773481268f2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.336634 Feb 17 03:30:47.842538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 338/715] 10.222.0.46 () {60 vars in 1170 bytes} [Wed Feb 17 03:30:47 2021] POST /compute/v2.1/os-security-groups => generated 241 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:47.854522 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ecc77f9e-daec-404e-a615-15f6159c229c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Action: 'create', calling method: .version_select at 0x7f013714f950>, body: {"security_group_rule": {"parent_group_id": "44ad59c9-be0b-482c-9e48-6f1aefbea8f1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:48.285745 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ecc77f9e-daec-404e-a615-15f6159c229c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.435200 Feb 17 03:30:48.287138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 378/716] 10.222.0.46 () {60 vars in 1185 bytes} [Wed Feb 17 03:30:47 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:48.298179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0f0ccda3-6cb8-4641-ae21-d54968e2a5f5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Action: 'create', calling method: .version_select at 0x7f012faadd90>, body: {"security_group_rule": {"parent_group_id": "44ad59c9-be0b-482c-9e48-6f1aefbea8f1", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:48.550295 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0f0ccda3-6cb8-4641-ae21-d54968e2a5f5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.256006 Feb 17 03:30:48.551140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 339/717] 10.222.0.46 () {60 vars in 1185 bytes} [Wed Feb 17 03:30:48 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:31:22.685863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:31:22.686362 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:31:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:31:22.941142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-48d2b82a-7483-4e27-9646-185c8d1fa1be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:22.941846 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-48d2b82a-7483-4e27-9646-185c8d1fa1be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:22.950846 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-48d2b82a-7483-4e27-9646-185c8d1fa1be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:22.951346 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-48d2b82a-7483-4e27-9646-185c8d1fa1be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:22.952202 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-48d2b82a-7483-4e27-9646-185c8d1fa1be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:22.952688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-48d2b82a-7483-4e27-9646-185c8d1fa1be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:23.389012 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-48d2b82a-7483-4e27-9646-185c8d1fa1be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lazy-loading 'services' on Instance uuid 415389d3-caaf-4b28-9090-426e4fe11633 {{(pid=98183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:31:23.535725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-48d2b82a-7483-4e27-9646-185c8d1fa1be tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "DELETE /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/os-volume_attachments/38a3d119-4436-4877-b95a-c9cc74e5578d" status: 202 len: 0 microversion: 2.1 time: 0.599808 Feb 17 03:31:23.536575 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 379/718] 10.222.0.46 () {58 vars in 1406 bytes} [Wed Feb 17 03:31:22 2021] DELETE /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/os-volume_attachments/38a3d119-4436-4877-b95a-c9cc74e5578d => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:25.866254 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-db0f6769-8f7e-47d0-8dd5-9a3896f411a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:25.876524 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db0f6769-8f7e-47d0-8dd5-9a3896f411a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:25.877245 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db0f6769-8f7e-47d0-8dd5-9a3896f411a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:25.970719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-db0f6769-8f7e-47d0-8dd5-9a3896f411a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Going to try to stop instance {{(pid=98184) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 17 03:31:26.067198 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-db0f6769-8f7e-47d0-8dd5-9a3896f411a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 202 len: 0 microversion: 2.1 time: 0.205477 Feb 17 03:31:26.071176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 340/719] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:25 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:26.078218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-efbb99ae-410f-41d5-a809-959020e655b5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:26.078988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-efbb99ae-410f-41d5-a809-959020e655b5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:26.089058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-efbb99ae-410f-41d5-a809-959020e655b5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:26.089565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-efbb99ae-410f-41d5-a809-959020e655b5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:26.090731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-efbb99ae-410f-41d5-a809-959020e655b5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:26.091219 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-efbb99ae-410f-41d5-a809-959020e655b5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:26.516813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-efbb99ae-410f-41d5-a809-959020e655b5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:26.526326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-efbb99ae-410f-41d5-a809-959020e655b5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.452998 Feb 17 03:31:26.526916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 380/720] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:26 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:27.546222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3dbcac82-fe30-418b-904f-7ac6e64b4d05 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:27.546953 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3dbcac82-fe30-418b-904f-7ac6e64b4d05 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:27.555080 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3dbcac82-fe30-418b-904f-7ac6e64b4d05 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:27.555632 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3dbcac82-fe30-418b-904f-7ac6e64b4d05 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:27.556476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3dbcac82-fe30-418b-904f-7ac6e64b4d05 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:27.556961 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3dbcac82-fe30-418b-904f-7ac6e64b4d05 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:27.944351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3dbcac82-fe30-418b-904f-7ac6e64b4d05 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:27.953836 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3dbcac82-fe30-418b-904f-7ac6e64b4d05 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.412617 Feb 17 03:31:27.954434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 341/721] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:27 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:28.972762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8e78175a-1c86-4aac-8b39-85455256ec8c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:28.973420 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8e78175a-1c86-4aac-8b39-85455256ec8c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:28.982007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8e78175a-1c86-4aac-8b39-85455256ec8c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:28.982514 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8e78175a-1c86-4aac-8b39-85455256ec8c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:28.983336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8e78175a-1c86-4aac-8b39-85455256ec8c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:28.983845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8e78175a-1c86-4aac-8b39-85455256ec8c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:29.190324 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8e78175a-1c86-4aac-8b39-85455256ec8c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:29.199161 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8e78175a-1c86-4aac-8b39-85455256ec8c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.230356 Feb 17 03:31:29.199806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 381/722] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:28 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:30.219963 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-60596783-8eea-48bd-b213-1433b303bf2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:30.220865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-60596783-8eea-48bd-b213-1433b303bf2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:30.230407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-60596783-8eea-48bd-b213-1433b303bf2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:30.231244 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-60596783-8eea-48bd-b213-1433b303bf2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:30.232201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-60596783-8eea-48bd-b213-1433b303bf2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:30.232618 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-60596783-8eea-48bd-b213-1433b303bf2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:30.461286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-60596783-8eea-48bd-b213-1433b303bf2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:30.471018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-60596783-8eea-48bd-b213-1433b303bf2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.255224 Feb 17 03:31:30.471594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 342/723] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:30 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:31.490206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-780fc1fa-a603-49a7-9570-9fe5e4911914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:31.490912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-780fc1fa-a603-49a7-9570-9fe5e4911914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:31.504622 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-780fc1fa-a603-49a7-9570-9fe5e4911914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:31.505483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-780fc1fa-a603-49a7-9570-9fe5e4911914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:31.506432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-780fc1fa-a603-49a7-9570-9fe5e4911914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:31.507020 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-780fc1fa-a603-49a7-9570-9fe5e4911914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:31.562840 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1726752333", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-940726939", "security_groups": [{"name": "tempest-TestShelveInstance-15226300"}], "networks": [{"uuid": "ed6be5ee-e98f-4e52-85de-7176df4698ac"}], "block_device_mapping_v2": [{"uuid": "5e9713b1-4603-404d-a3af-cc2aab4e8e62", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:31.803564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] validate_networks() for [('ed6be5ee-e98f-4e52-85de-7176df4698ac', None, None, None)] {{(pid=98184) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:31:31.938962 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-780fc1fa-a603-49a7-9570-9fe5e4911914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:31.948544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-780fc1fa-a603-49a7-9570-9fe5e4911914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.462498 Feb 17 03:31:31.949136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 382/724] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:31 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:32.402407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Flavor limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:31:32.402872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Image limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:31:32.403405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Flavor pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:31:32.403887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Image pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:31:32.404336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:31:32.413813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:32.414349 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:32.415224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:32.416262 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:32.435426 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Getting quotas for project 62cc4e74ed8a4799a22ac0af1dfb7c4b. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:31:32.439774 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Getting quotas for user 49d147b672c945dfb892ccc616d8f184 and project 62cc4e74ed8a4799a22ac0af1dfb7c4b. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:31:32.566747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Going to run 1 instances... {{(pid=98184) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:31:32.569216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e9713b1-4603-404d-a3af-cc2aab4e8e62',volume_size=None,volume_type=None)] {{(pid=98184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:31:32.754327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8815edf8-e82a-40bd-978e-fbd3fb8381d9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.195426 Feb 17 03:31:32.755019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 343/725] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:31:31 2021] POST /compute/v2.1/servers => generated 408 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:31:32.765461 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e24e35e2-104a-42e7-969a-e119d38ab186 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:32.766123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e24e35e2-104a-42e7-969a-e119d38ab186 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:32.862875 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e24e35e2-104a-42e7-969a-e119d38ab186 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:32.871449 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e24e35e2-104a-42e7-969a-e119d38ab186 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1088 microversion: 2.1 time: 0.109903 Feb 17 03:31:32.872047 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 383/726] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:32 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1088 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:32.967580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4f37cc4f-68e0-42e3-8e75-2b647dc5cfb0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:32.968250 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4f37cc4f-68e0-42e3-8e75-2b647dc5cfb0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:32.977342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f37cc4f-68e0-42e3-8e75-2b647dc5cfb0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:32.977839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f37cc4f-68e0-42e3-8e75-2b647dc5cfb0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:32.979540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f37cc4f-68e0-42e3-8e75-2b647dc5cfb0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:32.980028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f37cc4f-68e0-42e3-8e75-2b647dc5cfb0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:33.237910 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4f37cc4f-68e0-42e3-8e75-2b647dc5cfb0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:33.247097 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4f37cc4f-68e0-42e3-8e75-2b647dc5cfb0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.284649 Feb 17 03:31:33.248720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 344/727] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:32 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:33.889369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-14a8a1d0-2e22-406e-a39c-2cd564fd74d2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:33.890025 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-14a8a1d0-2e22-406e-a39c-2cd564fd74d2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:33.897816 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14a8a1d0-2e22-406e-a39c-2cd564fd74d2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:33.898309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14a8a1d0-2e22-406e-a39c-2cd564fd74d2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:33.899128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14a8a1d0-2e22-406e-a39c-2cd564fd74d2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:33.899657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14a8a1d0-2e22-406e-a39c-2cd564fd74d2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:34.023068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-14a8a1d0-2e22-406e-a39c-2cd564fd74d2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:34.031972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-14a8a1d0-2e22-406e-a39c-2cd564fd74d2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1138 microversion: 2.1 time: 0.146546 Feb 17 03:31:34.032573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 384/728] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:33 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1138 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:34.266081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b61db4ce-c07b-427b-9adb-dc749741b6f3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:34.266747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b61db4ce-c07b-427b-9adb-dc749741b6f3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:34.274476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b61db4ce-c07b-427b-9adb-dc749741b6f3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:34.275530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b61db4ce-c07b-427b-9adb-dc749741b6f3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:34.276375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b61db4ce-c07b-427b-9adb-dc749741b6f3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:34.276860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b61db4ce-c07b-427b-9adb-dc749741b6f3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:34.502531 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b61db4ce-c07b-427b-9adb-dc749741b6f3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:34.511835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b61db4ce-c07b-427b-9adb-dc749741b6f3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.249560 Feb 17 03:31:34.512500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 345/729] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:34 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:35.050283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8dbe8c98-d8d6-4a61-ba3c-c019f3c03ca0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:35.050941 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8dbe8c98-d8d6-4a61-ba3c-c019f3c03ca0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:35.059451 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8dbe8c98-d8d6-4a61-ba3c-c019f3c03ca0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:35.059990 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8dbe8c98-d8d6-4a61-ba3c-c019f3c03ca0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:35.060820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8dbe8c98-d8d6-4a61-ba3c-c019f3c03ca0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:35.061386 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8dbe8c98-d8d6-4a61-ba3c-c019f3c03ca0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:35.187697 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8dbe8c98-d8d6-4a61-ba3c-c019f3c03ca0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:35.197120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8dbe8c98-d8d6-4a61-ba3c-c019f3c03ca0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1130 microversion: 2.1 time: 0.150784 Feb 17 03:31:35.198364 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 385/730] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:35 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1130 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:35.530813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4e88d394-4390-457b-b393-855fa931ebe3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:35.531406 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4e88d394-4390-457b-b393-855fa931ebe3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:35.539054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e88d394-4390-457b-b393-855fa931ebe3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:35.539576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e88d394-4390-457b-b393-855fa931ebe3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:35.540395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e88d394-4390-457b-b393-855fa931ebe3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:35.540935 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e88d394-4390-457b-b393-855fa931ebe3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:35.803392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4e88d394-4390-457b-b393-855fa931ebe3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:35.814785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4e88d394-4390-457b-b393-855fa931ebe3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.288098 Feb 17 03:31:35.815721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 346/731] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:35 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:36.217888 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bf477c5b-6ed6-4b53-a6a6-5e25b8712226 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:36.218561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bf477c5b-6ed6-4b53-a6a6-5e25b8712226 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:36.231148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf477c5b-6ed6-4b53-a6a6-5e25b8712226 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:36.231699 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf477c5b-6ed6-4b53-a6a6-5e25b8712226 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:36.232652 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf477c5b-6ed6-4b53-a6a6-5e25b8712226 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:36.233148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf477c5b-6ed6-4b53-a6a6-5e25b8712226 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:36.372608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bf477c5b-6ed6-4b53-a6a6-5e25b8712226 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:36.383479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bf477c5b-6ed6-4b53-a6a6-5e25b8712226 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1204 microversion: 2.1 time: 0.171739 Feb 17 03:31:36.384151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 386/732] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:36 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1204 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:36.833417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f56cce3b-785c-4bd5-8df8-311330c84750 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:36.834325 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f56cce3b-785c-4bd5-8df8-311330c84750 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:36.842691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f56cce3b-785c-4bd5-8df8-311330c84750 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:36.843180 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f56cce3b-785c-4bd5-8df8-311330c84750 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:36.844247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f56cce3b-785c-4bd5-8df8-311330c84750 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:36.844731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f56cce3b-785c-4bd5-8df8-311330c84750 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:37.110482 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f56cce3b-785c-4bd5-8df8-311330c84750 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:37.120268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f56cce3b-785c-4bd5-8df8-311330c84750 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.290248 Feb 17 03:31:37.121115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 347/733] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:36 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:37.403319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5fd15435-fa66-436c-9c9d-514f6f08aec8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:37.404890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5fd15435-fa66-436c-9c9d-514f6f08aec8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:37.414263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5fd15435-fa66-436c-9c9d-514f6f08aec8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:37.414917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5fd15435-fa66-436c-9c9d-514f6f08aec8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:37.417191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5fd15435-fa66-436c-9c9d-514f6f08aec8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:37.417707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5fd15435-fa66-436c-9c9d-514f6f08aec8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:37.549430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bb3ec057-65a1-4a54-baf5-5da4bc0d13e4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:37.550018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bb3ec057-65a1-4a54-baf5-5da4bc0d13e4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:37.558503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb3ec057-65a1-4a54-baf5-5da4bc0d13e4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:37.559014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb3ec057-65a1-4a54-baf5-5da4bc0d13e4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:37.559886 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb3ec057-65a1-4a54-baf5-5da4bc0d13e4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:37.560361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb3ec057-65a1-4a54-baf5-5da4bc0d13e4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:37.631019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bb3ec057-65a1-4a54-baf5-5da4bc0d13e4 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/os-volume_attachments/f9ef5e14-98c6-4653-80f9-fc4588bdcb37" status: 200 len: 194 microversion: 2.20 time: 0.085922 Feb 17 03:31:37.631598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 348/734] 10.222.0.46 () {60 vars in 1444 bytes} [Wed Feb 17 03:31:37 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/os-volume_attachments/f9ef5e14-98c6-4653-80f9-fc4588bdcb37 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:37.730423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5fd15435-fa66-436c-9c9d-514f6f08aec8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:37.740736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5fd15435-fa66-436c-9c9d-514f6f08aec8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1274 microversion: 2.1 time: 0.342088 Feb 17 03:31:37.747750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 387/735] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:37 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1274 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:37.779297 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d83d6e67-0160-4595-b56d-66bce9899a0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:37.779918 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d83d6e67-0160-4595-b56d-66bce9899a0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:37.787630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d83d6e67-0160-4595-b56d-66bce9899a0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:37.788140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d83d6e67-0160-4595-b56d-66bce9899a0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:37.788962 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d83d6e67-0160-4595-b56d-66bce9899a0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:37.789449 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d83d6e67-0160-4595-b56d-66bce9899a0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:37.961944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-d83d6e67-0160-4595-b56d-66bce9899a0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lazy-loading 'services' on Instance uuid a89d14a3-493e-413a-918e-fd2de544e689 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:31:38.139548 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fcf88b97-2295-43f2-b48b-d22dc4f32c2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:38.140228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fcf88b97-2295-43f2-b48b-d22dc4f32c2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:38.148189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fcf88b97-2295-43f2-b48b-d22dc4f32c2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:38.148767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fcf88b97-2295-43f2-b48b-d22dc4f32c2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:38.149848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fcf88b97-2295-43f2-b48b-d22dc4f32c2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:38.150356 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fcf88b97-2295-43f2-b48b-d22dc4f32c2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:38.195431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d83d6e67-0160-4595-b56d-66bce9899a0e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/os-volume_attachments/f9ef5e14-98c6-4653-80f9-fc4588bdcb37" status: 202 len: 0 microversion: 2.20 time: 0.420703 Feb 17 03:31:38.196722 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 349/736] 10.222.0.46 () {60 vars in 1447 bytes} [Wed Feb 17 03:31:37 2021] DELETE /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689/os-volume_attachments/f9ef5e14-98c6-4653-80f9-fc4588bdcb37 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:31:38.397862 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fcf88b97-2295-43f2-b48b-d22dc4f32c2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:38.406856 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fcf88b97-2295-43f2-b48b-d22dc4f32c2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.272480 Feb 17 03:31:38.407656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 388/737] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:38 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:38.759275 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4e03e4d1-8848-45ae-93d5-dc67ec9a8604 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:38.760093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4e03e4d1-8848-45ae-93d5-dc67ec9a8604 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:38.768134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e03e4d1-8848-45ae-93d5-dc67ec9a8604 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:38.768634 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e03e4d1-8848-45ae-93d5-dc67ec9a8604 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:38.769457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e03e4d1-8848-45ae-93d5-dc67ec9a8604 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:38.769940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e03e4d1-8848-45ae-93d5-dc67ec9a8604 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:38.984796 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4e03e4d1-8848-45ae-93d5-dc67ec9a8604 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:38.993832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4e03e4d1-8848-45ae-93d5-dc67ec9a8604 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1274 microversion: 2.1 time: 0.239282 Feb 17 03:31:38.994588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 350/738] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:38 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1274 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:39.425739 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-34ab84b7-6e9a-40b1-b3de-d65b2bb1faab tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:39.427569 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-34ab84b7-6e9a-40b1-b3de-d65b2bb1faab tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:39.437983 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-34ab84b7-6e9a-40b1-b3de-d65b2bb1faab tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:39.438635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-34ab84b7-6e9a-40b1-b3de-d65b2bb1faab tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:39.439781 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-34ab84b7-6e9a-40b1-b3de-d65b2bb1faab tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:39.440495 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-34ab84b7-6e9a-40b1-b3de-d65b2bb1faab tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:39.705148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-34ab84b7-6e9a-40b1-b3de-d65b2bb1faab tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:39.715282 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-34ab84b7-6e9a-40b1-b3de-d65b2bb1faab tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.293635 Feb 17 03:31:39.716079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 389/739] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:39 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:40.012503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1044d370-f34a-4de0-bc2a-71fada96485e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:40.013156 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1044d370-f34a-4de0-bc2a-71fada96485e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:40.021392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1044d370-f34a-4de0-bc2a-71fada96485e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:40.022128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1044d370-f34a-4de0-bc2a-71fada96485e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:40.022964 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1044d370-f34a-4de0-bc2a-71fada96485e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:40.023460 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1044d370-f34a-4de0-bc2a-71fada96485e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:40.357104 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1044d370-f34a-4de0-bc2a-71fada96485e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:40.367559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1044d370-f34a-4de0-bc2a-71fada96485e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1274 microversion: 2.1 time: 0.359192 Feb 17 03:31:40.369756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 351/740] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:40 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1274 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:40.715101 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-f453b872-065b-4032-94d4-ed371f77f644 req-ececc2bf-079d-425d-b2ac-0c166579dd35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053ba632-5ab2-451f-96b5-adff294a7cb7", "tag": "ee2e0f68-7311-4134-9186-6f27cbf5411a"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:40.720155 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:31:40.720155 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:31:40.734505 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-529f353b-6dc3-4872-ad20-e025bd4131d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:40.735611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-529f353b-6dc3-4872-ad20-e025bd4131d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:40.741033 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f453b872-065b-4032-94d4-ed371f77f644 req-ececc2bf-079d-425d-b2ac-0c166579dd35 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:40.741540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f453b872-065b-4032-94d4-ed371f77f644 req-ececc2bf-079d-425d-b2ac-0c166579dd35 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:40.747715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-529f353b-6dc3-4872-ad20-e025bd4131d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:40.748226 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-529f353b-6dc3-4872-ad20-e025bd4131d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:40.749071 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-529f353b-6dc3-4872-ad20-e025bd4131d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:40.749609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-529f353b-6dc3-4872-ad20-e025bd4131d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:40.801576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-f453b872-065b-4032-94d4-ed371f77f644 req-ececc2bf-079d-425d-b2ac-0c166579dd35 service nova] Creating event network-changed:ee2e0f68-7311-4134-9186-6f27cbf5411a for instance 053ba632-5ab2-451f-96b5-adff294a7cb7 on hv-cinder-75996 Feb 17 03:31:40.808860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-f453b872-065b-4032-94d4-ed371f77f644 req-ececc2bf-079d-425d-b2ac-0c166579dd35 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099981 Feb 17 03:31:40.815193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 390/741] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:31:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:31:41.209105 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-529f353b-6dc3-4872-ad20-e025bd4131d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:41.220585 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-529f353b-6dc3-4872-ad20-e025bd4131d3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.489942 Feb 17 03:31:41.221456 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 352/742] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:40 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:41.386111 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fd16dc8e-3bc7-45fe-94f2-c8bf25c4c8eb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:41.386868 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fd16dc8e-3bc7-45fe-94f2-c8bf25c4c8eb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:41.394872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd16dc8e-3bc7-45fe-94f2-c8bf25c4c8eb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:41.395367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd16dc8e-3bc7-45fe-94f2-c8bf25c4c8eb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:41.396215 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd16dc8e-3bc7-45fe-94f2-c8bf25c4c8eb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:41.396696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd16dc8e-3bc7-45fe-94f2-c8bf25c4c8eb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:41.624453 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fd16dc8e-3bc7-45fe-94f2-c8bf25c4c8eb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:41.633290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fd16dc8e-3bc7-45fe-94f2-c8bf25c4c8eb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.251729 Feb 17 03:31:41.633878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 391/743] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:41 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:42.238469 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a154643c-7582-48cd-9e40-5fad83493146 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:42.239132 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a154643c-7582-48cd-9e40-5fad83493146 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:42.247957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a154643c-7582-48cd-9e40-5fad83493146 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:42.248706 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a154643c-7582-48cd-9e40-5fad83493146 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:42.249526 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a154643c-7582-48cd-9e40-5fad83493146 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:42.250207 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a154643c-7582-48cd-9e40-5fad83493146 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:42.461048 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a154643c-7582-48cd-9e40-5fad83493146 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:42.470797 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a154643c-7582-48cd-9e40-5fad83493146 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.235992 Feb 17 03:31:42.471318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 353/744] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:42 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:42.650435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-de9787bc-467b-48c8-9cb8-3b4c1081d1f4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:42.651153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-de9787bc-467b-48c8-9cb8-3b4c1081d1f4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:42.658992 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-de9787bc-467b-48c8-9cb8-3b4c1081d1f4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:42.659491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-de9787bc-467b-48c8-9cb8-3b4c1081d1f4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:42.660359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-de9787bc-467b-48c8-9cb8-3b4c1081d1f4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:42.660845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-de9787bc-467b-48c8-9cb8-3b4c1081d1f4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:42.877079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-de9787bc-467b-48c8-9cb8-3b4c1081d1f4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:42.886166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-de9787bc-467b-48c8-9cb8-3b4c1081d1f4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.239732 Feb 17 03:31:42.886963 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 392/745] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:42 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:43.489189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2d5f791b-508a-45ea-b60b-de4bc3bce9e1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:43.489855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2d5f791b-508a-45ea-b60b-de4bc3bce9e1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:43.497611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d5f791b-508a-45ea-b60b-de4bc3bce9e1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:43.498115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d5f791b-508a-45ea-b60b-de4bc3bce9e1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:43.498930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d5f791b-508a-45ea-b60b-de4bc3bce9e1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:43.499412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d5f791b-508a-45ea-b60b-de4bc3bce9e1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:43.710642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2d5f791b-508a-45ea-b60b-de4bc3bce9e1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:43.720177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2d5f791b-508a-45ea-b60b-de4bc3bce9e1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.234940 Feb 17 03:31:43.720766 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 354/746] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:43 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:43.906633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b4c0b02a-e55f-434c-906a-70b7fa292e4a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:43.907424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b4c0b02a-e55f-434c-906a-70b7fa292e4a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:43.916178 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4c0b02a-e55f-434c-906a-70b7fa292e4a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:43.916931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4c0b02a-e55f-434c-906a-70b7fa292e4a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:43.917839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4c0b02a-e55f-434c-906a-70b7fa292e4a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:43.918462 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4c0b02a-e55f-434c-906a-70b7fa292e4a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:44.140325 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b4c0b02a-e55f-434c-906a-70b7fa292e4a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:44.149691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b4c0b02a-e55f-434c-906a-70b7fa292e4a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.248843 Feb 17 03:31:44.150323 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 393/747] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:43 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:44.738715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a6cf0171-e39b-42e9-b00c-aa92dd55784b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:44.740015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a6cf0171-e39b-42e9-b00c-aa92dd55784b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:44.757320 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a6cf0171-e39b-42e9-b00c-aa92dd55784b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:44.757972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a6cf0171-e39b-42e9-b00c-aa92dd55784b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:44.759007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a6cf0171-e39b-42e9-b00c-aa92dd55784b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:44.759489 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a6cf0171-e39b-42e9-b00c-aa92dd55784b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:45.001131 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a6cf0171-e39b-42e9-b00c-aa92dd55784b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:45.010239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a6cf0171-e39b-42e9-b00c-aa92dd55784b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1678 microversion: 2.1 time: 0.275628 Feb 17 03:31:45.010824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 355/748] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:44 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1678 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:45.167588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-351f693f-e51c-4900-a0c2-4a1902efd63e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:45.168252 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-351f693f-e51c-4900-a0c2-4a1902efd63e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:45.183221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-351f693f-e51c-4900-a0c2-4a1902efd63e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:45.183753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-351f693f-e51c-4900-a0c2-4a1902efd63e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:45.184795 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-351f693f-e51c-4900-a0c2-4a1902efd63e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:45.185013 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-351f693f-e51c-4900-a0c2-4a1902efd63e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:45.404756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-351f693f-e51c-4900-a0c2-4a1902efd63e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:45.415763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-351f693f-e51c-4900-a0c2-4a1902efd63e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.252054 Feb 17 03:31:45.416424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 394/749] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:45 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:45.543126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-726d3782-b908-47ac-9b1a-149d3ca71dd0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:45.543708 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-726d3782-b908-47ac-9b1a-149d3ca71dd0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:45.551417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-726d3782-b908-47ac-9b1a-149d3ca71dd0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:45.551960 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-726d3782-b908-47ac-9b1a-149d3ca71dd0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:45.552792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-726d3782-b908-47ac-9b1a-149d3ca71dd0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:45.553283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-726d3782-b908-47ac-9b1a-149d3ca71dd0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:45.617893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-726d3782-b908-47ac-9b1a-149d3ca71dd0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Going to try to terminate instance {{(pid=98184) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:31:45.734982 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-726d3782-b908-47ac-9b1a-149d3ca71dd0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 204 len: 0 microversion: 2.20 time: 0.195537 Feb 17 03:31:45.735655 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 356/750] 10.222.0.46 () {60 vars in 1270 bytes} [Wed Feb 17 03:31:45 2021] DELETE /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 03:31:45.745320 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5eb4785c-8dda-4460-8af9-763d38917cb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:45.746204 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5eb4785c-8dda-4460-8af9-763d38917cb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:45.754149 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5eb4785c-8dda-4460-8af9-763d38917cb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:45.754734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5eb4785c-8dda-4460-8af9-763d38917cb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:45.755696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5eb4785c-8dda-4460-8af9-763d38917cb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:45.756186 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5eb4785c-8dda-4460-8af9-763d38917cb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.029497 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3b597ad3-030f-4f94-8b07-6ad45b342d67 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:46.030344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3b597ad3-030f-4f94-8b07-6ad45b342d67 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:46.038567 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b597ad3-030f-4f94-8b07-6ad45b342d67 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.039071 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b597ad3-030f-4f94-8b07-6ad45b342d67 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.039961 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b597ad3-030f-4f94-8b07-6ad45b342d67 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.040458 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3b597ad3-030f-4f94-8b07-6ad45b342d67 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.244985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5eb4785c-8dda-4460-8af9-763d38917cb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:46.254142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5eb4785c-8dda-4460-8af9-763d38917cb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:46.255755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5eb4785c-8dda-4460-8af9-763d38917cb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:46.256924 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5eb4785c-8dda-4460-8af9-763d38917cb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.516592 Feb 17 03:31:46.257488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 395/751] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:31:45 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:31:46.306060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3b597ad3-030f-4f94-8b07-6ad45b342d67 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:46.314854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3b597ad3-030f-4f94-8b07-6ad45b342d67 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1655 microversion: 2.1 time: 0.289998 Feb 17 03:31:46.315442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 357/752] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:46 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1655 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:46.332201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-83cda2d2-07ab-4374-ae5c-4d9a6087e803 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:46.340570 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83cda2d2-07ab-4374-ae5c-4d9a6087e803 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.341068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83cda2d2-07ab-4374-ae5c-4d9a6087e803 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.402760 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-83cda2d2-07ab-4374-ae5c-4d9a6087e803 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Going to try to start instance {{(pid=98183) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 17 03:31:46.433537 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-06715abe-cad8-41cb-ac93-dc4f8a21351d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:46.435885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-06715abe-cad8-41cb-ac93-dc4f8a21351d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:46.443968 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-06715abe-cad8-41cb-ac93-dc4f8a21351d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.444471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-06715abe-cad8-41cb-ac93-dc4f8a21351d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.445297 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-06715abe-cad8-41cb-ac93-dc4f8a21351d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.445900 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-06715abe-cad8-41cb-ac93-dc4f8a21351d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.482665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-83cda2d2-07ab-4374-ae5c-4d9a6087e803 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action" status: 202 len: 0 microversion: 2.1 time: 0.154088 Feb 17 03:31:46.483844 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 396/753] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:46 2021] POST /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:46.493036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0c74b9ac-c0d5-4be6-b359-a1be0da68ba2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:46.493785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0c74b9ac-c0d5-4be6-b359-a1be0da68ba2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:46.502094 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c74b9ac-c0d5-4be6-b359-a1be0da68ba2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.502628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c74b9ac-c0d5-4be6-b359-a1be0da68ba2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.503452 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c74b9ac-c0d5-4be6-b359-a1be0da68ba2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.503957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c74b9ac-c0d5-4be6-b359-a1be0da68ba2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.748836 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-06715abe-cad8-41cb-ac93-dc4f8a21351d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:46.757912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-06715abe-cad8-41cb-ac93-dc4f8a21351d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.328450 Feb 17 03:31:46.758511 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 358/754] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:46 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:46.774868 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0c74b9ac-c0d5-4be6-b359-a1be0da68ba2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:46.784271 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0c74b9ac-c0d5-4be6-b359-a1be0da68ba2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1664 microversion: 2.1 time: 0.295685 Feb 17 03:31:46.784858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 397/755] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:46 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1664 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:47.277073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-304f913f-770b-4b03-8d42-7f657acdafb7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:47.277772 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-304f913f-770b-4b03-8d42-7f657acdafb7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:47.285620 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-304f913f-770b-4b03-8d42-7f657acdafb7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.286123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-304f913f-770b-4b03-8d42-7f657acdafb7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.286953 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-304f913f-770b-4b03-8d42-7f657acdafb7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.287441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-304f913f-770b-4b03-8d42-7f657acdafb7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.494007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-304f913f-770b-4b03-8d42-7f657acdafb7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:47.504011 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-304f913f-770b-4b03-8d42-7f657acdafb7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:47.505573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-304f913f-770b-4b03-8d42-7f657acdafb7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:47.506747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-304f913f-770b-4b03-8d42-7f657acdafb7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.233842 Feb 17 03:31:47.507333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 359/756] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:31:47 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:31:47.777093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a606b567-e357-4081-887d-8a3357e033c5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:47.777699 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a606b567-e357-4081-887d-8a3357e033c5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:47.785547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a606b567-e357-4081-887d-8a3357e033c5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.786047 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a606b567-e357-4081-887d-8a3357e033c5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.786861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a606b567-e357-4081-887d-8a3357e033c5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.787340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a606b567-e357-4081-887d-8a3357e033c5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.802386 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fed2f1a6-1192-4a35-be2d-3ab0855fed7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:47.803048 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fed2f1a6-1192-4a35-be2d-3ab0855fed7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:47.811028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fed2f1a6-1192-4a35-be2d-3ab0855fed7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.811583 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fed2f1a6-1192-4a35-be2d-3ab0855fed7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.812414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fed2f1a6-1192-4a35-be2d-3ab0855fed7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.812991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fed2f1a6-1192-4a35-be2d-3ab0855fed7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.122433 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fed2f1a6-1192-4a35-be2d-3ab0855fed7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:48.130666 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a606b567-e357-4081-887d-8a3357e033c5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:48.131751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fed2f1a6-1192-4a35-be2d-3ab0855fed7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1664 microversion: 2.1 time: 0.333251 Feb 17 03:31:48.132771 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 360/757] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:47 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1664 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:48.140120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a606b567-e357-4081-887d-8a3357e033c5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.367519 Feb 17 03:31:48.140707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 398/758] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:47 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:48.526389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-92cf4a8d-2359-4391-894a-52ab0ed7295c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:48.527112 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-92cf4a8d-2359-4391-894a-52ab0ed7295c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:48.535057 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-92cf4a8d-2359-4391-894a-52ab0ed7295c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.535639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-92cf4a8d-2359-4391-894a-52ab0ed7295c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.536467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-92cf4a8d-2359-4391-894a-52ab0ed7295c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.537002 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-92cf4a8d-2359-4391-894a-52ab0ed7295c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.747627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-92cf4a8d-2359-4391-894a-52ab0ed7295c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:48.756806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-92cf4a8d-2359-4391-894a-52ab0ed7295c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:48.758362 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-92cf4a8d-2359-4391-894a-52ab0ed7295c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:48.759536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-92cf4a8d-2359-4391-894a-52ab0ed7295c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.237239 Feb 17 03:31:48.760148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 361/759] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:31:48 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:31:49.150603 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6b110045-997e-42c4-9872-d008d10d9e6f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:49.151339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6b110045-997e-42c4-9872-d008d10d9e6f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:49.157752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-dd970456-3976-40e0-8f8a-d707983efc89 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:49.158414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-dd970456-3976-40e0-8f8a-d707983efc89 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:49.160317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b110045-997e-42c4-9872-d008d10d9e6f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:49.160903 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b110045-997e-42c4-9872-d008d10d9e6f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:49.161818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b110045-997e-42c4-9872-d008d10d9e6f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:49.162366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b110045-997e-42c4-9872-d008d10d9e6f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:49.166248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dd970456-3976-40e0-8f8a-d707983efc89 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:49.167253 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dd970456-3976-40e0-8f8a-d707983efc89 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:49.168184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dd970456-3976-40e0-8f8a-d707983efc89 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:49.168654 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dd970456-3976-40e0-8f8a-d707983efc89 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:49.505154 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6b110045-997e-42c4-9872-d008d10d9e6f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:49.512078 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-dd970456-3976-40e0-8f8a-d707983efc89 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:49.514291 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6b110045-997e-42c4-9872-d008d10d9e6f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1664 microversion: 2.1 time: 0.367579 Feb 17 03:31:49.515045 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 399/760] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:49 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1664 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:49.531944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-dd970456-3976-40e0-8f8a-d707983efc89 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.377943 Feb 17 03:31:49.532793 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 362/761] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:49 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:49.780526 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-469dc25c-25ec-4709-90c1-6ad3397cfd37 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:49.781364 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-469dc25c-25ec-4709-90c1-6ad3397cfd37 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:49.789616 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-469dc25c-25ec-4709-90c1-6ad3397cfd37 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:49.790199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-469dc25c-25ec-4709-90c1-6ad3397cfd37 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:49.791104 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-469dc25c-25ec-4709-90c1-6ad3397cfd37 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:49.791697 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-469dc25c-25ec-4709-90c1-6ad3397cfd37 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.001510 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-469dc25c-25ec-4709-90c1-6ad3397cfd37 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:50.012423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-469dc25c-25ec-4709-90c1-6ad3397cfd37 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:50.013914 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-469dc25c-25ec-4709-90c1-6ad3397cfd37 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:50.015087 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-469dc25c-25ec-4709-90c1-6ad3397cfd37 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.239401 Feb 17 03:31:50.015690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 400/762] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:31:49 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:31:50.532942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f1f92f36-b399-4842-bd20-8c85ab605784 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:50.533621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f1f92f36-b399-4842-bd20-8c85ab605784 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:50.541883 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f1f92f36-b399-4842-bd20-8c85ab605784 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:50.542385 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f1f92f36-b399-4842-bd20-8c85ab605784 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.543194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f1f92f36-b399-4842-bd20-8c85ab605784 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:50.544433 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f1f92f36-b399-4842-bd20-8c85ab605784 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.550221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b9d99827-f8ef-4c5b-afd6-ae9cefe519b6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:50.550894 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b9d99827-f8ef-4c5b-afd6-ae9cefe519b6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:50.559382 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b9d99827-f8ef-4c5b-afd6-ae9cefe519b6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:50.559911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b9d99827-f8ef-4c5b-afd6-ae9cefe519b6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.560742 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b9d99827-f8ef-4c5b-afd6-ae9cefe519b6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:50.561231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b9d99827-f8ef-4c5b-afd6-ae9cefe519b6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.861591 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f1f92f36-b399-4842-bd20-8c85ab605784 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:50.871253 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f1f92f36-b399-4842-bd20-8c85ab605784 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1664 microversion: 2.1 time: 0.342316 Feb 17 03:31:50.871961 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 363/763] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:50 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1664 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:50.872321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b9d99827-f8ef-4c5b-afd6-ae9cefe519b6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:50.881721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b9d99827-f8ef-4c5b-afd6-ae9cefe519b6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.335613 Feb 17 03:31:50.882301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 401/764] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:50 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:51.034638 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bf17a3c9-b4fb-4b62-83e8-ef558b2fdb2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:51.035285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bf17a3c9-b4fb-4b62-83e8-ef558b2fdb2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:51.043745 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf17a3c9-b4fb-4b62-83e8-ef558b2fdb2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.044189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf17a3c9-b4fb-4b62-83e8-ef558b2fdb2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.045002 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf17a3c9-b4fb-4b62-83e8-ef558b2fdb2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.045488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bf17a3c9-b4fb-4b62-83e8-ef558b2fdb2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.268479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bf17a3c9-b4fb-4b62-83e8-ef558b2fdb2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:51.278604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bf17a3c9-b4fb-4b62-83e8-ef558b2fdb2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:51.280225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bf17a3c9-b4fb-4b62-83e8-ef558b2fdb2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:51.281412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bf17a3c9-b4fb-4b62-83e8-ef558b2fdb2d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.250854 Feb 17 03:31:51.282002 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 364/765] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:31:51 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:31:51.891821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d0b72c93-3b7e-4496-87aa-1baa0e3ec172 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:51.892484 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d0b72c93-3b7e-4496-87aa-1baa0e3ec172 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:51.899370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-879203fa-6237-49d9-8c81-b5b3cf3f5e45 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:51.900138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-879203fa-6237-49d9-8c81-b5b3cf3f5e45 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:51.900351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0b72c93-3b7e-4496-87aa-1baa0e3ec172 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.900860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0b72c93-3b7e-4496-87aa-1baa0e3ec172 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.901692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0b72c93-3b7e-4496-87aa-1baa0e3ec172 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.902179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0b72c93-3b7e-4496-87aa-1baa0e3ec172 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.909539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-879203fa-6237-49d9-8c81-b5b3cf3f5e45 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.910025 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-879203fa-6237-49d9-8c81-b5b3cf3f5e45 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.910914 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-879203fa-6237-49d9-8c81-b5b3cf3f5e45 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.911880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-879203fa-6237-49d9-8c81-b5b3cf3f5e45 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:52.290997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d0b72c93-3b7e-4496-87aa-1baa0e3ec172 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:52.303058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d0b72c93-3b7e-4496-87aa-1baa0e3ec172 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1664 microversion: 2.1 time: 0.416952 Feb 17 03:31:52.309219 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-879203fa-6237-49d9-8c81-b5b3cf3f5e45 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:52.313515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 402/766] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:51 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1664 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:52.320016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ffd2e075-c4b0-48a3-a316-96ef294ba9be tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:52.320677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ffd2e075-c4b0-48a3-a316-96ef294ba9be tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:52.325236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-879203fa-6237-49d9-8c81-b5b3cf3f5e45 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.429734 Feb 17 03:31:52.331158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ffd2e075-c4b0-48a3-a316-96ef294ba9be tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:52.331732 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ffd2e075-c4b0-48a3-a316-96ef294ba9be tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:52.332694 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 365/767] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:51 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:52.337773 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ffd2e075-c4b0-48a3-a316-96ef294ba9be tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:52.338404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ffd2e075-c4b0-48a3-a316-96ef294ba9be tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:52.599582 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ffd2e075-c4b0-48a3-a316-96ef294ba9be tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:52.627108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ffd2e075-c4b0-48a3-a316-96ef294ba9be tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:52.629258 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ffd2e075-c4b0-48a3-a316-96ef294ba9be tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:52.630711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ffd2e075-c4b0-48a3-a316-96ef294ba9be tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1722 microversion: 2.20 time: 0.314948 Feb 17 03:31:52.631553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 403/768] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:31:52 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:31:53.328613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-82a9178b-0077-4a58-bf59-2ef88e316cef tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:53.329274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-82a9178b-0077-4a58-bf59-2ef88e316cef tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:53.337048 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82a9178b-0077-4a58-bf59-2ef88e316cef tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.337547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82a9178b-0077-4a58-bf59-2ef88e316cef tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.338913 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82a9178b-0077-4a58-bf59-2ef88e316cef tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.339391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82a9178b-0077-4a58-bf59-2ef88e316cef tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.351055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5bf76550-dcde-477b-b0cb-ec067af89616 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:53.351954 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5bf76550-dcde-477b-b0cb-ec067af89616 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:53.360616 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5bf76550-dcde-477b-b0cb-ec067af89616 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.361314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5bf76550-dcde-477b-b0cb-ec067af89616 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.362475 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5bf76550-dcde-477b-b0cb-ec067af89616 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.363124 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5bf76550-dcde-477b-b0cb-ec067af89616 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.745658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5bf76550-dcde-477b-b0cb-ec067af89616 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:53.756536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5bf76550-dcde-477b-b0cb-ec067af89616 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.409708 Feb 17 03:31:53.767345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 404/769] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:53 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:53.767345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-256e88fc-e352-4b0e-a0be-49d8faaf5947 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:53.767345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-256e88fc-e352-4b0e-a0be-49d8faaf5947 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:53.772641 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-256e88fc-e352-4b0e-a0be-49d8faaf5947 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.773231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-256e88fc-e352-4b0e-a0be-49d8faaf5947 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.774140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-256e88fc-e352-4b0e-a0be-49d8faaf5947 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.774777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-256e88fc-e352-4b0e-a0be-49d8faaf5947 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.905597 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-256e88fc-e352-4b0e-a0be-49d8faaf5947 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:53.915215 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-256e88fc-e352-4b0e-a0be-49d8faaf5947 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:53.916894 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-256e88fc-e352-4b0e-a0be-49d8faaf5947 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:53.918068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-256e88fc-e352-4b0e-a0be-49d8faaf5947 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1655 microversion: 2.20 time: 0.159188 Feb 17 03:31:53.918839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 405/770] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:31:53 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:31:53.979054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-82a9178b-0077-4a58-bf59-2ef88e316cef tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:53.988925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-82a9178b-0077-4a58-bf59-2ef88e316cef tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1668 microversion: 2.1 time: 0.664108 Feb 17 03:31:53.989657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 366/771] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:53 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1668 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:54.774445 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a440832b-9180-4cd0-b14f-961efd80654f tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:54.775164 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a440832b-9180-4cd0-b14f-961efd80654f tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:54.793238 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a440832b-9180-4cd0-b14f-961efd80654f tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:54.793793 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a440832b-9180-4cd0-b14f-961efd80654f tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:54.794645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a440832b-9180-4cd0-b14f-961efd80654f tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:54.795139 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a440832b-9180-4cd0-b14f-961efd80654f tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:55.085422 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-6c565aa1-a2b9-4690-8467-6411bb4acb90 req-5c722b42-8391-4aa2-b2c7-5f33761fc059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89d14a3-493e-413a-918e-fd2de544e689", "name": "network-vif-deleted", "tag": "8e645981-866a-495c-83c8-d0e1206a99d1"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:55.087181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:31:55.087181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:31:55.102922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-6c565aa1-a2b9-4690-8467-6411bb4acb90 req-5c722b42-8391-4aa2-b2c7-5f33761fc059 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:55.104212 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-6c565aa1-a2b9-4690-8467-6411bb4acb90 req-5c722b42-8391-4aa2-b2c7-5f33761fc059 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:55.129539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-6c565aa1-a2b9-4690-8467-6411bb4acb90 req-5c722b42-8391-4aa2-b2c7-5f33761fc059 service nova] Creating event network-vif-deleted:8e645981-866a-495c-83c8-d0e1206a99d1 for instance a89d14a3-493e-413a-918e-fd2de544e689 on hv-cinder-75996 Feb 17 03:31:55.142351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-6c565aa1-a2b9-4690-8467-6411bb4acb90 req-5c722b42-8391-4aa2-b2c7-5f33761fc059 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324890 Feb 17 03:31:55.145449 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 367/772] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:31:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:31:55.158871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:55.159655 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:55.185782 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:55.188122 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:55.189163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:55.190219 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:55.196580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a440832b-9180-4cd0-b14f-961efd80654f tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:55.225972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a440832b-9180-4cd0-b14f-961efd80654f tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.455345 Feb 17 03:31:55.226840 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 406/773] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:54 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:55.299029 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:55.299545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:55.300332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lazy-loading 'fault' on Instance uuid a89d14a3-493e-413a-918e-fd2de544e689 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:31:55.371179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:55.382564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:55.384166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:55.386481 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a28ba056-4948-4726-90f2-c0dae9b36505 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 200 len: 1371 microversion: 2.20 time: 0.232139 Feb 17 03:31:55.387572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 368/774] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:31:55 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:31:56.244887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a917c140-35e4-40e9-991d-93cd446d7693 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:56.245513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a917c140-35e4-40e9-991d-93cd446d7693 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:56.264507 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a917c140-35e4-40e9-991d-93cd446d7693 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.265256 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a917c140-35e4-40e9-991d-93cd446d7693 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.266286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a917c140-35e4-40e9-991d-93cd446d7693 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.269317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a917c140-35e4-40e9-991d-93cd446d7693 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.406552 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-156a09cc-9112-4a6f-a99f-5b098bf2f115 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:56.407248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-156a09cc-9112-4a6f-a99f-5b098bf2f115 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:56.431474 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-156a09cc-9112-4a6f-a99f-5b098bf2f115 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.433285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-156a09cc-9112-4a6f-a99f-5b098bf2f115 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.436244 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-156a09cc-9112-4a6f-a99f-5b098bf2f115 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.437371 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-156a09cc-9112-4a6f-a99f-5b098bf2f115 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.537923 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-156a09cc-9112-4a6f-a99f-5b098bf2f115 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] HTTP exception thrown: Instance a89d14a3-493e-413a-918e-fd2de544e689 could not be found. Feb 17 03:31:56.538835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-156a09cc-9112-4a6f-a99f-5b098bf2f115 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Returning 404 to user: Instance a89d14a3-493e-413a-918e-fd2de544e689 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:31:56.540164 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-156a09cc-9112-4a6f-a99f-5b098bf2f115 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 404 len: 111 microversion: 2.20 time: 0.138548 Feb 17 03:31:56.541996 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 369/775] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:31:56 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:31:56.705316 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a917c140-35e4-40e9-991d-93cd446d7693 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:56.717602 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a917c140-35e4-40e9-991d-93cd446d7693 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.477226 Feb 17 03:31:56.718537 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 407/776] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:56 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:56.724913 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3cfaa26e-fc5f-4f76-a2d1-ad8a41b559a8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '.version_select at 0x7f012e4c6620>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:56.758090 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3cfaa26e-fc5f-4f76-a2d1-ad8a41b559a8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522223405" status: 204 len: 0 microversion: 2.20 time: 0.037911 Feb 17 03:31:56.759049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 408/777] 10.222.0.46 () {60 vars in 1252 bytes} [Wed Feb 17 03:31:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1522223405 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 03:31:56.890045 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-58ee33f9-5d7a-4fde-b32b-f9838589a5ae req-bbd892d0-3cf1-4f2d-a944-a7dbbd863c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053ba632-5ab2-451f-96b5-adff294a7cb7", "name": "network-vif-plugged", "status": "completed", "tag": "ee2e0f68-7311-4134-9186-6f27cbf5411a"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:56.891787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:31:56.891787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:31:56.907896 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-58ee33f9-5d7a-4fde-b32b-f9838589a5ae req-bbd892d0-3cf1-4f2d-a944-a7dbbd863c12 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.908725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-58ee33f9-5d7a-4fde-b32b-f9838589a5ae req-bbd892d0-3cf1-4f2d-a944-a7dbbd863c12 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.929702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-58ee33f9-5d7a-4fde-b32b-f9838589a5ae req-bbd892d0-3cf1-4f2d-a944-a7dbbd863c12 service nova] Creating event network-vif-plugged:ee2e0f68-7311-4134-9186-6f27cbf5411a for instance 053ba632-5ab2-451f-96b5-adff294a7cb7 on hv-cinder-75996 Feb 17 03:31:56.935468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-58ee33f9-5d7a-4fde-b32b-f9838589a5ae req-bbd892d0-3cf1-4f2d-a944-a7dbbd863c12 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.391881 Feb 17 03:31:56.936502 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 370/778] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:31:57.736203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-086c69c4-8287-4423-ae94-15a7a2180bab tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:57.736966 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-086c69c4-8287-4423-ae94-15a7a2180bab tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:57.755311 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-086c69c4-8287-4423-ae94-15a7a2180bab tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:57.756372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-086c69c4-8287-4423-ae94-15a7a2180bab tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:57.757453 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-086c69c4-8287-4423-ae94-15a7a2180bab tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:57.759665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-086c69c4-8287-4423-ae94-15a7a2180bab tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:58.306703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-086c69c4-8287-4423-ae94-15a7a2180bab tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:58.321244 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-086c69c4-8287-4423-ae94-15a7a2180bab tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1262 microversion: 2.1 time: 0.588925 Feb 17 03:31:58.322280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 409/779] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:57 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1262 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:58.656812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-dc7d9a19-a58d-4d93-a9ef-012087dc4b74 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'create', calling method: .version_select at 0x7f012db78d08>, body: {"keypair": {"name": "tempest-keypair-2045486363"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:58.693338 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-dc7d9a19-a58d-4d93-a9ef-012087dc4b74 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Getting quotas for project 7d8b1f2f62fe46bd86f2158ff4c88376. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:31:58.699072 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-dc7d9a19-a58d-4d93-a9ef-012087dc4b74 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Getting quotas for user 4b5d48272f134d44a615b37af1bbbed6 and project 7d8b1f2f62fe46bd86f2158ff4c88376. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:31:58.885827 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-dc7d9a19-a58d-4d93-a9ef-012087dc4b74 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Getting quotas for project 7d8b1f2f62fe46bd86f2158ff4c88376. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:31:58.890063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-dc7d9a19-a58d-4d93-a9ef-012087dc4b74 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Getting quotas for user 4b5d48272f134d44a615b37af1bbbed6 and project 7d8b1f2f62fe46bd86f2158ff4c88376. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:31:58.907187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-dc7d9a19-a58d-4d93-a9ef-012087dc4b74 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.255121 Feb 17 03:31:58.908121 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 371/780] 10.222.0.46 () {62 vars in 1189 bytes} [Wed Feb 17 03:31:58 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 257 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 17 03:31:59.339544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a27e8c93-e144-4d38-9376-ec1642415d7c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:59.340719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a27e8c93-e144-4d38-9376-ec1642415d7c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:59.350229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a27e8c93-e144-4d38-9376-ec1642415d7c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:59.351167 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a27e8c93-e144-4d38-9376-ec1642415d7c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:59.352538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a27e8c93-e144-4d38-9376-ec1642415d7c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:59.354487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a27e8c93-e144-4d38-9376-ec1642415d7c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:59.891099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a27e8c93-e144-4d38-9376-ec1642415d7c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:59.901615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a27e8c93-e144-4d38-9376-ec1642415d7c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1447 microversion: 2.1 time: 0.566876 Feb 17 03:31:59.902194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 410/781] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:59 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1447 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:59.920995 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4c209506-0fc8-4517-9c82-a532e8468ec5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:59.921777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4c209506-0fc8-4517-9c82-a532e8468ec5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:59.930162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4c209506-0fc8-4517-9c82-a532e8468ec5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:59.930855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4c209506-0fc8-4517-9c82-a532e8468ec5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:59.931737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4c209506-0fc8-4517-9c82-a532e8468ec5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:59.932228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4c209506-0fc8-4517-9c82-a532e8468ec5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:00.263031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4c209506-0fc8-4517-9c82-a532e8468ec5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:00.273501 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4c209506-0fc8-4517-9c82-a532e8468ec5 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1447 microversion: 2.1 time: 0.357084 Feb 17 03:32:00.274626 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 372/782] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:59 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1447 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:00.293363 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b6a2b423-dd00-4122-8d5c-cd5b213d43f9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Action: 'create', calling method: .version_select at 0x7f012e4c6268>, body: {"pool": null} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:02.705943 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b6a2b423-dd00-4122-8d5c-cd5b213d43f9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.417895 Feb 17 03:32:02.707679 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 411/783] 10.222.0.46 () {60 vars in 1160 bytes} [Wed Feb 17 03:32:00 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:32:02.721539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3ada4967-0485-4c92-891b-9dfb88fc3dbb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Action: 'action', calling method: .version_select at 0x7f012fcb3ae8>, body: {"addFloatingIp": {"address": "172.27.1.180"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:02.722806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3ada4967-0485-4c92-891b-9dfb88fc3dbb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:02.736240 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3ada4967-0485-4c92-891b-9dfb88fc3dbb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:02.737554 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3ada4967-0485-4c92-891b-9dfb88fc3dbb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:02.738607 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3ada4967-0485-4c92-891b-9dfb88fc3dbb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:02.739334 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3ada4967-0485-4c92-891b-9dfb88fc3dbb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:02.741329 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1192019724", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb8f45f6-f6e6-4160-8b4b-ea43f62275bd"}], "security_groups": [{"name": "tempest-securitygroup--1776876299"}], "key_name": "tempest-keypair-2045486363", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:02.814287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3ada4967-0485-4c92-891b-9dfb88fc3dbb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Acquired lock "refresh_cache-053ba632-5ab2-451f-96b5-adff294a7cb7" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:32:02.961746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] validate_networks() for [('cb8f45f6-f6e6-4160-8b4b-ea43f62275bd', None, None, None)] {{(pid=98183) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:32:04.911809 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Flavor limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:32:04.913506 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Image limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:32:04.914697 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Flavor pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:32:04.915874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Image pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:32:04.917117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:32:04.931417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:04.932031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:04.933334 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:04.933824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:04.957275 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Getting quotas for project 7d8b1f2f62fe46bd86f2158ff4c88376. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:32:04.961572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Getting quotas for user 4b5d48272f134d44a615b37af1bbbed6 and project 7d8b1f2f62fe46bd86f2158ff4c88376. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:32:04.973558 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Going to run 1 instances... {{(pid=98183) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:32:04.976714 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:32:05.035456 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-93f4c638-7c7c-4f5b-bb9f-4d4dc7e301d1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.299445 Feb 17 03:32:05.036785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 412/784] 10.222.0.46 () {62 vars in 1178 bytes} [Wed Feb 17 03:32:02 2021] POST /compute/v2.1/servers => generated 402 bytes in 2301 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 17 03:32:05.047998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-27dbd3b4-397f-4f0c-97da-24968ec20d72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:05.048664 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-27dbd3b4-397f-4f0c-97da-24968ec20d72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:05.158411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-27dbd3b4-397f-4f0c-97da-24968ec20d72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:05.169889 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-27dbd3b4-397f-4f0c-97da-24968ec20d72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:05.171657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-27dbd3b4-397f-4f0c-97da-24968ec20d72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:05.172969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-27dbd3b4-397f-4f0c-97da-24968ec20d72 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1282 microversion: 2.20 time: 0.129101 Feb 17 03:32:05.173629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 413/785] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:05 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1282 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:05.540856 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1061454243", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:05.640168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] validate_networks() for None {{(pid=98183) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:32:06.140270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-3ada4967-0485-4c92-891b-9dfb88fc3dbb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Building network info cache for instance {{(pid=98184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:32:06.428690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Flavor limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:32:06.429513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Image limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:32:06.430269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Flavor pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:32:06.431137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Image pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:32:06.431875 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:32:06.446098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:06.448994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:06.450144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:06.451933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:06.495769 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Getting quotas for project 93d670c588834f31bf8ef73c70730640. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:32:06.504548 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Getting quotas for user 9e2a8e3b56f946669ecabdb79a8065fc and project 93d670c588834f31bf8ef73c70730640. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:32:06.536425 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Going to run 1 instances... {{(pid=98183) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:32:06.539383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:32:06.661766 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-91175c7d-f245-429b-adfa-ccff76519a6a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125001 Feb 17 03:32:06.668546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 414/786] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:32:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:32:07.057640 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-49c3d589-69f8-4486-ad74-ad0a0ff4e8c2 req-9f85aa17-4522-4c44-8830-062690af9785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053ba632-5ab2-451f-96b5-adff294a7cb7", "tag": "ee2e0f68-7311-4134-9186-6f27cbf5411a"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:07.059676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:07.059676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:07.081515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-49c3d589-69f8-4486-ad74-ad0a0ff4e8c2 req-9f85aa17-4522-4c44-8830-062690af9785 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:07.087026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-49c3d589-69f8-4486-ad74-ad0a0ff4e8c2 req-9f85aa17-4522-4c44-8830-062690af9785 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:07.122644 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-49c3d589-69f8-4486-ad74-ad0a0ff4e8c2 req-9f85aa17-4522-4c44-8830-062690af9785 service nova] Creating event network-changed:ee2e0f68-7311-4134-9186-6f27cbf5411a for instance 053ba632-5ab2-451f-96b5-adff294a7cb7 on hv-cinder-75996 Feb 17 03:32:07.136343 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-49c3d589-69f8-4486-ad74-ad0a0ff4e8c2 req-9f85aa17-4522-4c44-8830-062690af9785 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.465971 Feb 17 03:32:07.152709 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 415/787] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:07.158963 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cb6828ed-4f6e-4c8b-907c-48bcc788c674 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:07.173729 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cb6828ed-4f6e-4c8b-907c-48bcc788c674 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:07.216343 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cb6828ed-4f6e-4c8b-907c-48bcc788c674 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:07.219227 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cb6828ed-4f6e-4c8b-907c-48bcc788c674 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:07.220604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cb6828ed-4f6e-4c8b-907c-48bcc788c674 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:07.226852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cb6828ed-4f6e-4c8b-907c-48bcc788c674 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:07.531309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cb6828ed-4f6e-4c8b-907c-48bcc788c674 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:07.545392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cb6828ed-4f6e-4c8b-907c-48bcc788c674 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:07.546963 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cb6828ed-4f6e-4c8b-907c-48bcc788c674 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:07.548136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cb6828ed-4f6e-4c8b-907c-48bcc788c674 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1340 microversion: 2.20 time: 0.393593 Feb 17 03:32:07.548713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 416/788] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:07 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1340 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:07.563012 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ef87c417-4b9c-4088-b46a-29ab39d6154d tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:07.580571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ef87c417-4b9c-4088-b46a-29ab39d6154d tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:07.589483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef87c417-4b9c-4088-b46a-29ab39d6154d tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:07.590317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef87c417-4b9c-4088-b46a-29ab39d6154d tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:07.593504 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef87c417-4b9c-4088-b46a-29ab39d6154d tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:07.594257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef87c417-4b9c-4088-b46a-29ab39d6154d tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:07.856442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ef87c417-4b9c-4088-b46a-29ab39d6154d tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:07.867438 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ef87c417-4b9c-4088-b46a-29ab39d6154d tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1219 microversion: 2.1 time: 0.311833 Feb 17 03:32:07.873231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 417/789] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:07 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1219 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:08.570812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5a511cb3-fdae-4ccc-af2f-d9a085e289a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:08.579485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5a511cb3-fdae-4ccc-af2f-d9a085e289a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:08.610430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5a511cb3-fdae-4ccc-af2f-d9a085e289a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:08.610941 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5a511cb3-fdae-4ccc-af2f-d9a085e289a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:08.611854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5a511cb3-fdae-4ccc-af2f-d9a085e289a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:08.612354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5a511cb3-fdae-4ccc-af2f-d9a085e289a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:08.910698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-3ada4967-0485-4c92-891b-9dfb88fc3dbb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Updating instance_info_cache with network_info: [{"id": "ee2e0f68-7311-4134-9186-6f27cbf5411a", "address": "fa:16:3e:75:b0:c7", "network": {"id": "ed6be5ee-e98f-4e52-85de-7176df4698ac", "bridge": "br-int", "label": "tempest-TestShelveInstance-1617143255-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "62cc4e74ed8a4799a22ac0af1dfb7c4b", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapee2e0f68-73", "ovs_interfaceid": "ee2e0f68-7311-4134-9186-6f27cbf5411a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:32:08.947021 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3ada4967-0485-4c92-891b-9dfb88fc3dbb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Releasing lock "refresh_cache-053ba632-5ab2-451f-96b5-adff294a7cb7" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:32:08.948332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3ada4967-0485-4c92-891b-9dfb88fc3dbb tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "POST /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7/action" status: 202 len: 0 microversion: 2.1 time: 6.230928 Feb 17 03:32:08.949698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 373/790] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:02 2021] POST /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7/action => generated 0 bytes in 6233 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 03:32:08.954580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f3833cdc-750d-4716-8440-fade3c76057c tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:08.956881 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f3833cdc-750d-4716-8440-fade3c76057c tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:08.979698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f3833cdc-750d-4716-8440-fade3c76057c tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:08.982396 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f3833cdc-750d-4716-8440-fade3c76057c tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:08.983503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f3833cdc-750d-4716-8440-fade3c76057c tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:08.984446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f3833cdc-750d-4716-8440-fade3c76057c tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:09.037810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5a511cb3-fdae-4ccc-af2f-d9a085e289a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:09.054539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5a511cb3-fdae-4ccc-af2f-d9a085e289a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:09.058926 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5a511cb3-fdae-4ccc-af2f-d9a085e289a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:09.060220 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5a511cb3-fdae-4ccc-af2f-d9a085e289a6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1340 microversion: 2.20 time: 0.493674 Feb 17 03:32:09.062245 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 418/791] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:08 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1340 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:09.209142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f3833cdc-750d-4716-8440-fade3c76057c tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:09.233937 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f3833cdc-750d-4716-8440-fade3c76057c tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1273 microversion: 2.1 time: 0.282863 Feb 17 03:32:09.234735 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 374/792] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:08 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1273 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:10.083346 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9962be0a-b8c4-4281-b45a-749828e35fb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:10.084046 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9962be0a-b8c4-4281-b45a-749828e35fb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:10.092661 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9962be0a-b8c4-4281-b45a-749828e35fb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:10.093091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9962be0a-b8c4-4281-b45a-749828e35fb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:10.093943 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9962be0a-b8c4-4281-b45a-749828e35fb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:10.094434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9962be0a-b8c4-4281-b45a-749828e35fb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:10.253264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-40ebe8af-dda2-49e5-80fa-03f9b99473b4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:10.253938 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-40ebe8af-dda2-49e5-80fa-03f9b99473b4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:10.272916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40ebe8af-dda2-49e5-80fa-03f9b99473b4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:10.273468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40ebe8af-dda2-49e5-80fa-03f9b99473b4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:10.274251 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40ebe8af-dda2-49e5-80fa-03f9b99473b4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:10.274741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40ebe8af-dda2-49e5-80fa-03f9b99473b4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:10.605020 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-40ebe8af-dda2-49e5-80fa-03f9b99473b4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:10.618406 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-40ebe8af-dda2-49e5-80fa-03f9b99473b4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1273 microversion: 2.1 time: 0.369277 Feb 17 03:32:10.626251 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 375/793] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:10 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1273 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:10.686228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9962be0a-b8c4-4281-b45a-749828e35fb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:10.700068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9962be0a-b8c4-4281-b45a-749828e35fb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:10.701893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9962be0a-b8c4-4281-b45a-749828e35fb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:10.703218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9962be0a-b8c4-4281-b45a-749828e35fb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1408 microversion: 2.20 time: 0.625168 Feb 17 03:32:10.706670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 419/794] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:10 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1408 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:11.644478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cbbde895-bb2f-4a63-ada5-de5f29113e68 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:11.645147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cbbde895-bb2f-4a63-ada5-de5f29113e68 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:11.662443 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cbbde895-bb2f-4a63-ada5-de5f29113e68 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.663288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cbbde895-bb2f-4a63-ada5-de5f29113e68 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.664382 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cbbde895-bb2f-4a63-ada5-de5f29113e68 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.665062 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cbbde895-bb2f-4a63-ada5-de5f29113e68 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.726494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2d33a57d-a967-4d20-8161-75d1ee4058bc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:11.727165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2d33a57d-a967-4d20-8161-75d1ee4058bc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:11.741283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d33a57d-a967-4d20-8161-75d1ee4058bc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.741789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d33a57d-a967-4d20-8161-75d1ee4058bc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.742647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d33a57d-a967-4d20-8161-75d1ee4058bc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.743142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d33a57d-a967-4d20-8161-75d1ee4058bc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:12.378852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2d33a57d-a967-4d20-8161-75d1ee4058bc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:12.388818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2d33a57d-a967-4d20-8161-75d1ee4058bc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:12.390683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2d33a57d-a967-4d20-8161-75d1ee4058bc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:12.391814 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2d33a57d-a967-4d20-8161-75d1ee4058bc tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1408 microversion: 2.20 time: 0.669712 Feb 17 03:32:12.394643 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 420/795] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:11 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1408 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:12.485461 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cbbde895-bb2f-4a63-ada5-de5f29113e68 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:12.495652 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cbbde895-bb2f-4a63-ada5-de5f29113e68 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1315 microversion: 2.1 time: 0.855124 Feb 17 03:32:12.496577 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 376/796] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:11 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1315 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:13.278659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-3756c43d-3714-462c-b790-ff92b397eaad req-501851b9-dc1b-4c60-a6c0-988238e05c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f420e97-ea65-416f-bcb1-3912244b4f06", "tag": "ec0e37c1-8234-4d0f-97f8-aeb6924765b5"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:13.280538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:13.280538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:13.289329 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-3756c43d-3714-462c-b790-ff92b397eaad req-501851b9-dc1b-4c60-a6c0-988238e05c2b service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:13.289829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-3756c43d-3714-462c-b790-ff92b397eaad req-501851b9-dc1b-4c60-a6c0-988238e05c2b service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:13.317543 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-3756c43d-3714-462c-b790-ff92b397eaad req-501851b9-dc1b-4c60-a6c0-988238e05c2b service nova] Creating event network-changed:ec0e37c1-8234-4d0f-97f8-aeb6924765b5 for instance 4f420e97-ea65-416f-bcb1-3912244b4f06 on hv-cinder-75996 Feb 17 03:32:13.325921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-3756c43d-3714-462c-b790-ff92b397eaad req-501851b9-dc1b-4c60-a6c0-988238e05c2b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051573 Feb 17 03:32:13.326584 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 421/797] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:13.414651 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c1c214a7-6d2f-4976-9422-85777fd5bd44 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:13.415470 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c1c214a7-6d2f-4976-9422-85777fd5bd44 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:13.432985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c1c214a7-6d2f-4976-9422-85777fd5bd44 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:13.438355 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c1c214a7-6d2f-4976-9422-85777fd5bd44 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:13.439612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c1c214a7-6d2f-4976-9422-85777fd5bd44 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:13.440754 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c1c214a7-6d2f-4976-9422-85777fd5bd44 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:13.524106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-aca3f0b0-b842-45f4-96cb-040aa44b3014 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:13.525149 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-aca3f0b0-b842-45f4-96cb-040aa44b3014 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:13.549506 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aca3f0b0-b842-45f4-96cb-040aa44b3014 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:13.551828 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aca3f0b0-b842-45f4-96cb-040aa44b3014 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:13.555690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aca3f0b0-b842-45f4-96cb-040aa44b3014 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:13.556678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aca3f0b0-b842-45f4-96cb-040aa44b3014 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:14.608702 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c1c214a7-6d2f-4976-9422-85777fd5bd44 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:14.613787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-aca3f0b0-b842-45f4-96cb-040aa44b3014 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:14.623319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c1c214a7-6d2f-4976-9422-85777fd5bd44 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:14.623461 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-aca3f0b0-b842-45f4-96cb-040aa44b3014 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1315 microversion: 2.1 time: 1.112645 Feb 17 03:32:14.624074 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 422/798] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:13 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1315 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:14.624973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c1c214a7-6d2f-4976-9422-85777fd5bd44 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:14.626551 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c1c214a7-6d2f-4976-9422-85777fd5bd44 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1408 microversion: 2.20 time: 1.216226 Feb 17 03:32:14.627390 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 377/799] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:13 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1408 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:14.629735 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-ab841c8d-2f3f-4ea5-b157-af93fa3b1355 req-9dc2032a-67f2-4ba9-afdd-60d191ab8552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c24f4ad-6fbd-441f-8a47-4ca0b607824b", "tag": "2de21df3-be2b-4299-9864-1e6434dd3e18"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:14.631654 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:14.631654 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:14.641228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-ab841c8d-2f3f-4ea5-b157-af93fa3b1355 req-9dc2032a-67f2-4ba9-afdd-60d191ab8552 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:14.641728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-ab841c8d-2f3f-4ea5-b157-af93fa3b1355 req-9dc2032a-67f2-4ba9-afdd-60d191ab8552 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:14.659910 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-ab841c8d-2f3f-4ea5-b157-af93fa3b1355 req-9dc2032a-67f2-4ba9-afdd-60d191ab8552 service nova] Creating event network-changed:2de21df3-be2b-4299-9864-1e6434dd3e18 for instance 9c24f4ad-6fbd-441f-8a47-4ca0b607824b on hv-cinder-75996 Feb 17 03:32:14.664817 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-ab841c8d-2f3f-4ea5-b157-af93fa3b1355 req-9dc2032a-67f2-4ba9-afdd-60d191ab8552 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039255 Feb 17 03:32:14.665462 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 423/800] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:15.642863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-32885c13-80a6-4a0e-ba3c-acdb8a96f111 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:15.644043 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-32885c13-80a6-4a0e-ba3c-acdb8a96f111 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:15.652547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-32885c13-80a6-4a0e-ba3c-acdb8a96f111 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:15.653289 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-32885c13-80a6-4a0e-ba3c-acdb8a96f111 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:15.654273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-32885c13-80a6-4a0e-ba3c-acdb8a96f111 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:15.654909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-32885c13-80a6-4a0e-ba3c-acdb8a96f111 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:15.655776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-45b995cd-598c-41ed-b5db-79b8f6574576 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:15.656721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-45b995cd-598c-41ed-b5db-79b8f6574576 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:15.666491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45b995cd-598c-41ed-b5db-79b8f6574576 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:15.667149 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45b995cd-598c-41ed-b5db-79b8f6574576 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:15.668167 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45b995cd-598c-41ed-b5db-79b8f6574576 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:15.668770 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45b995cd-598c-41ed-b5db-79b8f6574576 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:16.296609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-32885c13-80a6-4a0e-ba3c-acdb8a96f111 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:16.305943 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-32885c13-80a6-4a0e-ba3c-acdb8a96f111 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1315 microversion: 2.1 time: 0.666927 Feb 17 03:32:16.306815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 378/801] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:15 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:16.366729 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-45b995cd-598c-41ed-b5db-79b8f6574576 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:16.377317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-45b995cd-598c-41ed-b5db-79b8f6574576 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:16.379163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-45b995cd-598c-41ed-b5db-79b8f6574576 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:16.380595 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-45b995cd-598c-41ed-b5db-79b8f6574576 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1408 microversion: 2.20 time: 0.731631 Feb 17 03:32:16.381469 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 424/802] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:15 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1408 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:17.325137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1a3ff5d0-544a-4f77-9c04-27d30b2d418e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:17.325964 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1a3ff5d0-544a-4f77-9c04-27d30b2d418e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:17.334370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a3ff5d0-544a-4f77-9c04-27d30b2d418e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:17.334862 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a3ff5d0-544a-4f77-9c04-27d30b2d418e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:17.336008 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a3ff5d0-544a-4f77-9c04-27d30b2d418e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:17.336510 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a3ff5d0-544a-4f77-9c04-27d30b2d418e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:17.400373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8b5f9006-085e-45c5-90aa-e67b5d514f02 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:17.401049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8b5f9006-085e-45c5-90aa-e67b5d514f02 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:17.418061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8b5f9006-085e-45c5-90aa-e67b5d514f02 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:17.418836 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8b5f9006-085e-45c5-90aa-e67b5d514f02 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:17.419933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8b5f9006-085e-45c5-90aa-e67b5d514f02 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:17.420427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8b5f9006-085e-45c5-90aa-e67b5d514f02 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:18.060258 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1a3ff5d0-544a-4f77-9c04-27d30b2d418e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:18.064054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8b5f9006-085e-45c5-90aa-e67b5d514f02 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:18.071249 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1a3ff5d0-544a-4f77-9c04-27d30b2d418e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1315 microversion: 2.1 time: 0.750789 Feb 17 03:32:18.078104 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8b5f9006-085e-45c5-90aa-e67b5d514f02 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:18.081078 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8b5f9006-085e-45c5-90aa-e67b5d514f02 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:18.082251 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 379/803] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:17 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:18.083820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8b5f9006-085e-45c5-90aa-e67b5d514f02 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1408 microversion: 2.20 time: 0.686222 Feb 17 03:32:18.095996 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 425/804] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:17 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1408 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:19.090292 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1a2cc16f-1bb4-45a1-9f54-d623b4ec9998 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:19.091105 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1a2cc16f-1bb4-45a1-9f54-d623b4ec9998 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:19.098978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a2cc16f-1bb4-45a1-9f54-d623b4ec9998 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.099493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a2cc16f-1bb4-45a1-9f54-d623b4ec9998 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.100620 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a2cc16f-1bb4-45a1-9f54-d623b4ec9998 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.101105 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a2cc16f-1bb4-45a1-9f54-d623b4ec9998 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.106537 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b5385ef5-8a9b-49c3-be51-652ec6ee07b8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:19.107478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b5385ef5-8a9b-49c3-be51-652ec6ee07b8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:19.117786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5385ef5-8a9b-49c3-be51-652ec6ee07b8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.118790 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5385ef5-8a9b-49c3-be51-652ec6ee07b8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.120311 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5385ef5-8a9b-49c3-be51-652ec6ee07b8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.121174 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b5385ef5-8a9b-49c3-be51-652ec6ee07b8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.931412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b5385ef5-8a9b-49c3-be51-652ec6ee07b8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:19.942848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b5385ef5-8a9b-49c3-be51-652ec6ee07b8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:19.943812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1a2cc16f-1bb4-45a1-9f54-d623b4ec9998 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:19.944457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b5385ef5-8a9b-49c3-be51-652ec6ee07b8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:19.945785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b5385ef5-8a9b-49c3-be51-652ec6ee07b8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1408 microversion: 2.20 time: 0.843864 Feb 17 03:32:19.946359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 426/805] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:19 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1408 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:19.951315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-4b58a06a-71b1-432b-8fa3-7d0b7115f9d9 req-c774c570-f647-4644-89ff-9193df0676a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c24f4ad-6fbd-441f-8a47-4ca0b607824b", "name": "network-vif-plugged", "status": "completed", "tag": "2de21df3-be2b-4299-9864-1e6434dd3e18"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:19.953229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:19.953229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:19.962559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-4b58a06a-71b1-432b-8fa3-7d0b7115f9d9 req-c774c570-f647-4644-89ff-9193df0676a8 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.963888 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-4b58a06a-71b1-432b-8fa3-7d0b7115f9d9 req-c774c570-f647-4644-89ff-9193df0676a8 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.964686 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1a2cc16f-1bb4-45a1-9f54-d623b4ec9998 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1315 microversion: 2.1 time: 0.878825 Feb 17 03:32:19.965505 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 380/806] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:19 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1315 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:19.983639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-4b58a06a-71b1-432b-8fa3-7d0b7115f9d9 req-c774c570-f647-4644-89ff-9193df0676a8 service nova] Creating event network-vif-plugged:2de21df3-be2b-4299-9864-1e6434dd3e18 for instance 9c24f4ad-6fbd-441f-8a47-4ca0b607824b on hv-cinder-75996 Feb 17 03:32:19.988766 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-4b58a06a-71b1-432b-8fa3-7d0b7115f9d9 req-c774c570-f647-4644-89ff-9193df0676a8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040956 Feb 17 03:32:19.989569 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 427/807] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:20.965976 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-aaa24951-5f4b-4108-8e42-8b2f67f5a1ad tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:20.966866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-aaa24951-5f4b-4108-8e42-8b2f67f5a1ad tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:20.975025 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aaa24951-5f4b-4108-8e42-8b2f67f5a1ad tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:20.977086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aaa24951-5f4b-4108-8e42-8b2f67f5a1ad tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:20.977086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aaa24951-5f4b-4108-8e42-8b2f67f5a1ad tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:20.983815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-834dd6af-756f-4afc-bba0-51ef4e780758 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:20.984662 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-834dd6af-756f-4afc-bba0-51ef4e780758 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:20.989280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aaa24951-5f4b-4108-8e42-8b2f67f5a1ad tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:20.993505 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-834dd6af-756f-4afc-bba0-51ef4e780758 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:20.994406 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-834dd6af-756f-4afc-bba0-51ef4e780758 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:20.995338 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-834dd6af-756f-4afc-bba0-51ef4e780758 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:20.995953 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-834dd6af-756f-4afc-bba0-51ef4e780758 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:21.578837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-aaa24951-5f4b-4108-8e42-8b2f67f5a1ad tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:21.594711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-834dd6af-756f-4afc-bba0-51ef4e780758 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:21.603918 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-aaa24951-5f4b-4108-8e42-8b2f67f5a1ad tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:21.606918 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-834dd6af-756f-4afc-bba0-51ef4e780758 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1315 microversion: 2.1 time: 0.628207 Feb 17 03:32:21.608563 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-aaa24951-5f4b-4108-8e42-8b2f67f5a1ad tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:21.610219 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-aaa24951-5f4b-4108-8e42-8b2f67f5a1ad tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1408 microversion: 2.20 time: 0.648971 Feb 17 03:32:21.625176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 428/808] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:20 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:21.627061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 381/809] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:20 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1408 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:22.053448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-7f604fb8-3e49-48de-80d9-8d37c504b0cd req-448f8007-0cf5-4da3-90b1-06518ad1676b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f420e97-ea65-416f-bcb1-3912244b4f06", "name": "network-vif-plugged", "status": "completed", "tag": "ec0e37c1-8234-4d0f-97f8-aeb6924765b5"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:22.056623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:22.056623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:22.068247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-7f604fb8-3e49-48de-80d9-8d37c504b0cd req-448f8007-0cf5-4da3-90b1-06518ad1676b service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:22.068746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-7f604fb8-3e49-48de-80d9-8d37c504b0cd req-448f8007-0cf5-4da3-90b1-06518ad1676b service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:22.086691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-7f604fb8-3e49-48de-80d9-8d37c504b0cd req-448f8007-0cf5-4da3-90b1-06518ad1676b service nova] Creating event network-vif-plugged:ec0e37c1-8234-4d0f-97f8-aeb6924765b5 for instance 4f420e97-ea65-416f-bcb1-3912244b4f06 on hv-cinder-75996 Feb 17 03:32:22.091930 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-7f604fb8-3e49-48de-80d9-8d37c504b0cd req-448f8007-0cf5-4da3-90b1-06518ad1676b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045293 Feb 17 03:32:22.092892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 429/810] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:22.629570 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-830fdd8a-09db-4b09-a95a-f759cd86bf9b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:22.630424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-830fdd8a-09db-4b09-a95a-f759cd86bf9b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:22.640029 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-830fdd8a-09db-4b09-a95a-f759cd86bf9b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:22.640029 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-830fdd8a-09db-4b09-a95a-f759cd86bf9b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:22.640029 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-830fdd8a-09db-4b09-a95a-f759cd86bf9b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:22.641049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-830fdd8a-09db-4b09-a95a-f759cd86bf9b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:22.646054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-24d99116-d81f-466d-95f4-3b72ff4fddd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:22.646825 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-24d99116-d81f-466d-95f4-3b72ff4fddd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:22.655385 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-24d99116-d81f-466d-95f4-3b72ff4fddd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:22.655860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-24d99116-d81f-466d-95f4-3b72ff4fddd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:22.656725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-24d99116-d81f-466d-95f4-3b72ff4fddd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:22.657200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-24d99116-d81f-466d-95f4-3b72ff4fddd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:23.133500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-830fdd8a-09db-4b09-a95a-f759cd86bf9b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:23.142802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-830fdd8a-09db-4b09-a95a-f759cd86bf9b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1465 microversion: 2.1 time: 0.517233 Feb 17 03:32:23.144192 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 382/811] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:22 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1465 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:23.166812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-24d99116-d81f-466d-95f4-3b72ff4fddd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:23.182201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-24d99116-d81f-466d-95f4-3b72ff4fddd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:23.184322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-24d99116-d81f-466d-95f4-3b72ff4fddd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:23.185741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-24d99116-d81f-466d-95f4-3b72ff4fddd9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1408 microversion: 2.20 time: 0.544172 Feb 17 03:32:23.186541 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 430/812] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:22 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1408 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:23.247788 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ef554612-d9d7-4160-9c36-30e974a8f4ec tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:23.248348 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ef554612-d9d7-4160-9c36-30e974a8f4ec tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:23.259839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef554612-d9d7-4160-9c36-30e974a8f4ec tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:23.260656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef554612-d9d7-4160-9c36-30e974a8f4ec tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:23.262176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef554612-d9d7-4160-9c36-30e974a8f4ec tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:23.263665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef554612-d9d7-4160-9c36-30e974a8f4ec tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:23.342494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ef554612-d9d7-4160-9c36-30e974a8f4ec tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Going to try to terminate instance {{(pid=98184) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:32:23.515208 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ef554612-d9d7-4160-9c36-30e974a8f4ec tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 204 len: 0 microversion: 2.1 time: 0.271240 Feb 17 03:32:23.516535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 383/813] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:32:23 2021] DELETE /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:32:23.525798 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2884b7cf-ecd5-4608-92b6-1603a58f4ac7 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:23.527004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2884b7cf-ecd5-4608-92b6-1603a58f4ac7 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:23.535382 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2884b7cf-ecd5-4608-92b6-1603a58f4ac7 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:23.536113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2884b7cf-ecd5-4608-92b6-1603a58f4ac7 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:23.537127 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2884b7cf-ecd5-4608-92b6-1603a58f4ac7 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:23.537775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2884b7cf-ecd5-4608-92b6-1603a58f4ac7 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:23.933089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2884b7cf-ecd5-4608-92b6-1603a58f4ac7 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:23.942613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2884b7cf-ecd5-4608-92b6-1603a58f4ac7 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1471 microversion: 2.1 time: 0.421180 Feb 17 03:32:23.943296 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 431/814] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:23 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1471 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:24.210380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e0da9a73-c08f-41dd-b8a1-3c733170c1c8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:24.216165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e0da9a73-c08f-41dd-b8a1-3c733170c1c8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:24.234146 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0da9a73-c08f-41dd-b8a1-3c733170c1c8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:24.234895 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0da9a73-c08f-41dd-b8a1-3c733170c1c8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:24.237587 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0da9a73-c08f-41dd-b8a1-3c733170c1c8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:24.238314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e0da9a73-c08f-41dd-b8a1-3c733170c1c8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:24.865764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e0da9a73-c08f-41dd-b8a1-3c733170c1c8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:24.876959 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e0da9a73-c08f-41dd-b8a1-3c733170c1c8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:24.878542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e0da9a73-c08f-41dd-b8a1-3c733170c1c8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:24.879763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e0da9a73-c08f-41dd-b8a1-3c733170c1c8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1600 microversion: 2.20 time: 0.678318 Feb 17 03:32:24.880684 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 384/815] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:24 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1600 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:24.899710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-529c141d-73c2-4eb7-800b-3b5a6391197a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:24.902418 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-529c141d-73c2-4eb7-800b-3b5a6391197a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:24.911395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-529c141d-73c2-4eb7-800b-3b5a6391197a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:24.912122 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-529c141d-73c2-4eb7-800b-3b5a6391197a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:24.913137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-529c141d-73c2-4eb7-800b-3b5a6391197a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:24.913617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-529c141d-73c2-4eb7-800b-3b5a6391197a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:24.963370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-13042dfb-1f7f-4a21-80c1-99a39da9ae1e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:24.964069 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-13042dfb-1f7f-4a21-80c1-99a39da9ae1e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:24.976368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-13042dfb-1f7f-4a21-80c1-99a39da9ae1e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:24.976867 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-13042dfb-1f7f-4a21-80c1-99a39da9ae1e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:24.977767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-13042dfb-1f7f-4a21-80c1-99a39da9ae1e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:24.978289 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-13042dfb-1f7f-4a21-80c1-99a39da9ae1e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:25.227293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-529c141d-73c2-4eb7-800b-3b5a6391197a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.331967 Feb 17 03:32:25.234106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 432/816] 10.222.0.46 () {60 vars in 1306 bytes} [Wed Feb 17 03:32:24 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/os-interface => generated 285 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:25.705671 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-13042dfb-1f7f-4a21-80c1-99a39da9ae1e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:25.715151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-13042dfb-1f7f-4a21-80c1-99a39da9ae1e tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1471 microversion: 2.1 time: 0.756809 Feb 17 03:32:25.722302 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 385/817] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:24 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1471 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:26.353539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b8db7c2d-5d29-4202-bef3-38583f236fad tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'create', calling method: .version_select at 0x7f012e690730>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1857685246"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:26.377366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-b8db7c2d-5d29-4202-bef3-38583f236fad tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Getting quotas for project fce55aed27e14d6791193d35e5ac2137. Resources: {'key_pairs'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:32:26.381645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-b8db7c2d-5d29-4202-bef3-38583f236fad tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Getting quotas for user a08274bcef1c4e73a39e60b3a11b09d1 and project fce55aed27e14d6791193d35e5ac2137. Resources: {'key_pairs'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:32:26.589611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-b8db7c2d-5d29-4202-bef3-38583f236fad tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Getting quotas for project fce55aed27e14d6791193d35e5ac2137. Resources: {'key_pairs'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:32:26.593565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-b8db7c2d-5d29-4202-bef3-38583f236fad tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Getting quotas for user a08274bcef1c4e73a39e60b3a11b09d1 and project fce55aed27e14d6791193d35e5ac2137. Resources: {'key_pairs'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:32:26.607821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b8db7c2d-5d29-4202-bef3-38583f236fad tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.459929 Feb 17 03:32:26.608479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 433/818] 10.222.0.46 () {60 vars in 1148 bytes} [Wed Feb 17 03:32:26 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:26.618951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b2c93e93-0018-48e0-945c-34173efb8447 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'create', calling method: .version_select at 0x7f012db788c8>, body: {"security_group": {"name": "tempest-TestVolumeBootPattern-2001516187", "description": "tempest-TestVolumeBootPattern-2001516187 description"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:26.734077 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b8fba2ec-0d21-4d7f-a8e9-086ae0e54f8b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:26.734757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b8fba2ec-0d21-4d7f-a8e9-086ae0e54f8b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:26.744415 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b8fba2ec-0d21-4d7f-a8e9-086ae0e54f8b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:26.744929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b8fba2ec-0d21-4d7f-a8e9-086ae0e54f8b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:26.745789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b8fba2ec-0d21-4d7f-a8e9-086ae0e54f8b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:26.746281 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b8fba2ec-0d21-4d7f-a8e9-086ae0e54f8b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:27.667813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b8fba2ec-0d21-4d7f-a8e9-086ae0e54f8b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:27.678580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b8fba2ec-0d21-4d7f-a8e9-086ae0e54f8b tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1471 microversion: 2.1 time: 0.948602 Feb 17 03:32:27.683080 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 434/819] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:26 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1471 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:27.688216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-5fbcd88d-7378-4671-b020-d74f35df7423 req-73bf394a-c907-4932-9bbd-dc1b3a75e217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c24f4ad-6fbd-441f-8a47-4ca0b607824b", "name": "network-vif-unplugged", "status": "completed", "tag": "2de21df3-be2b-4299-9864-1e6434dd3e18"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:27.689858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:27.689858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:27.700001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-5fbcd88d-7378-4671-b020-d74f35df7423 req-73bf394a-c907-4932-9bbd-dc1b3a75e217 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:27.700494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-5fbcd88d-7378-4671-b020-d74f35df7423 req-73bf394a-c907-4932-9bbd-dc1b3a75e217 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:27.722588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-5fbcd88d-7378-4671-b020-d74f35df7423 req-73bf394a-c907-4932-9bbd-dc1b3a75e217 service nova] Creating event network-vif-unplugged:2de21df3-be2b-4299-9864-1e6434dd3e18 for instance 9c24f4ad-6fbd-441f-8a47-4ca0b607824b on hv-cinder-75996 Feb 17 03:32:27.729336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-5fbcd88d-7378-4671-b020-d74f35df7423 req-73bf394a-c907-4932-9bbd-dc1b3a75e217 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044219 Feb 17 03:32:27.730345 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 435/820] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:27.895764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b2c93e93-0018-48e0-945c-34173efb8447 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 1.280537 Feb 17 03:32:27.909646 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9296ded2-5331-4b13-9683-ad4cba1d813f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'create', calling method: .version_select at 0x7f012e4c6268>, body: {"security_group_rule": {"parent_group_id": "1cd712cf-7c9f-4ad9-9741-bb196d1f45dd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:27.909992 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 386/821] 10.222.0.46 () {60 vars in 1170 bytes} [Wed Feb 17 03:32:26 2021] POST /compute/v2.1/os-security-groups => generated 251 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:28.571136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4d1950ea-cb0d-483e-9511-3a602444da22 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:28.572867 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4d1950ea-cb0d-483e-9511-3a602444da22 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:28.585585 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d1950ea-cb0d-483e-9511-3a602444da22 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:28.587491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d1950ea-cb0d-483e-9511-3a602444da22 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:28.594108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d1950ea-cb0d-483e-9511-3a602444da22 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:28.594920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d1950ea-cb0d-483e-9511-3a602444da22 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:28.730502 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9296ded2-5331-4b13-9683-ad4cba1d813f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.825439 Feb 17 03:32:28.731949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 436/822] 10.222.0.46 () {60 vars in 1185 bytes} [Wed Feb 17 03:32:27 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:28.745535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-70a259fa-b530-40dd-9a9f-8e7cb344d0b6 req-3170a6cb-7615-43d4-9649-f3d9bbe0ae6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f420e97-ea65-416f-bcb1-3912244b4f06", "tag": "ec0e37c1-8234-4d0f-97f8-aeb6924765b5"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:28.747491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:28.747491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:28.758863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-70a259fa-b530-40dd-9a9f-8e7cb344d0b6 req-3170a6cb-7615-43d4-9649-f3d9bbe0ae6c service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:28.760762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-70a259fa-b530-40dd-9a9f-8e7cb344d0b6 req-3170a6cb-7615-43d4-9649-f3d9bbe0ae6c service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:28.782993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4d1950ea-cb0d-483e-9511-3a602444da22 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 14 microversion: 2.20 time: 0.214270 Feb 17 03:32:28.787431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 387/823] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:28 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:28.794925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-34785ca8-4f73-4656-a209-b502d9d55b8a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:28.795713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-34785ca8-4f73-4656-a209-b502d9d55b8a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:28.800326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-70a259fa-b530-40dd-9a9f-8e7cb344d0b6 req-3170a6cb-7615-43d4-9649-f3d9bbe0ae6c service nova] Creating event network-changed:ec0e37c1-8234-4d0f-97f8-aeb6924765b5 for instance 4f420e97-ea65-416f-bcb1-3912244b4f06 on hv-cinder-75996 Feb 17 03:32:28.804214 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-34785ca8-4f73-4656-a209-b502d9d55b8a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:28.804916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-34785ca8-4f73-4656-a209-b502d9d55b8a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:28.805905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-34785ca8-4f73-4656-a209-b502d9d55b8a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:28.807136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-70a259fa-b530-40dd-9a9f-8e7cb344d0b6 req-3170a6cb-7615-43d4-9649-f3d9bbe0ae6c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065386 Feb 17 03:32:28.807339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-34785ca8-4f73-4656-a209-b502d9d55b8a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:28.808179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 437/824] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:28.814220 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-303a2a04-f3c0-4004-8dec-bb2a0dd3779d tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'create', calling method: .version_select at 0x7f012e4c6c80>, body: {"security_group_rule": {"parent_group_id": "1cd712cf-7c9f-4ad9-9741-bb196d1f45dd", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:29.513428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-34785ca8-4f73-4656-a209-b502d9d55b8a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:29.529384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-34785ca8-4f73-4656-a209-b502d9d55b8a tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1471 microversion: 2.1 time: 0.740032 Feb 17 03:32:29.530280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 388/825] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:28 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1471 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:29.797091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-46aaac50-d09c-48c4-960a-36d3b6917b4f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:29.798144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-46aaac50-d09c-48c4-960a-36d3b6917b4f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:29.813476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46aaac50-d09c-48c4-960a-36d3b6917b4f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:29.813953 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46aaac50-d09c-48c4-960a-36d3b6917b4f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:29.818155 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46aaac50-d09c-48c4-960a-36d3b6917b4f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:29.819384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46aaac50-d09c-48c4-960a-36d3b6917b4f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:29.911999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-303a2a04-f3c0-4004-8dec-bb2a0dd3779d tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.102505 Feb 17 03:32:29.915067 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 438/826] 10.222.0.46 () {60 vars in 1185 bytes} [Wed Feb 17 03:32:28 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:29.990669 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-46aaac50-d09c-48c4-960a-36d3b6917b4f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 14 microversion: 2.20 time: 0.199251 Feb 17 03:32:29.991895 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 389/827] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:29 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:30.551479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-136fda5b-b47e-4824-a5e1-1eaa80d37088 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:30.552414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-136fda5b-b47e-4824-a5e1-1eaa80d37088 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:30.561484 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-136fda5b-b47e-4824-a5e1-1eaa80d37088 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:30.562122 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-136fda5b-b47e-4824-a5e1-1eaa80d37088 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:30.571942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-136fda5b-b47e-4824-a5e1-1eaa80d37088 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:30.574725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-136fda5b-b47e-4824-a5e1-1eaa80d37088 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:30.720192 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-136fda5b-b47e-4824-a5e1-1eaa80d37088 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:30.720997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-136fda5b-b47e-4824-a5e1-1eaa80d37088 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:30.721658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-136fda5b-b47e-4824-a5e1-1eaa80d37088 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lazy-loading 'fault' on Instance uuid 9c24f4ad-6fbd-441f-8a47-4ca0b607824b {{(pid=98183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:32:30.795073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-136fda5b-b47e-4824-a5e1-1eaa80d37088 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2a8e3b56f946669ecabdb79a8065fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d670c588834f31bf8ef73c70730640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:30.805333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-136fda5b-b47e-4824-a5e1-1eaa80d37088 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 200 len: 1305 microversion: 2.1 time: 0.259213 Feb 17 03:32:30.807108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 439/828] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:30 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 1305 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:30.861570 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-97054106-b1d8-4897-b37c-07e472c5b719 req-55175347-3f3e-41b9-a569-e79edeab672e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c24f4ad-6fbd-441f-8a47-4ca0b607824b", "name": "network-vif-deleted", "tag": "2de21df3-be2b-4299-9864-1e6434dd3e18"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:30.863934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:30.863934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:30.875959 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-97054106-b1d8-4897-b37c-07e472c5b719 req-55175347-3f3e-41b9-a569-e79edeab672e service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:30.876430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-97054106-b1d8-4897-b37c-07e472c5b719 req-55175347-3f3e-41b9-a569-e79edeab672e service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:30.893905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-97054106-b1d8-4897-b37c-07e472c5b719 req-55175347-3f3e-41b9-a569-e79edeab672e service nova] Creating event network-vif-deleted:2de21df3-be2b-4299-9864-1e6434dd3e18 for instance 9c24f4ad-6fbd-441f-8a47-4ca0b607824b on hv-cinder-75996 Feb 17 03:32:30.898813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-97054106-b1d8-4897-b37c-07e472c5b719 req-55175347-3f3e-41b9-a569-e79edeab672e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041601 Feb 17 03:32:30.899434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 390/829] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:31.001871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1be74142-b864-439c-b9bf-2fdf085c3c48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:31.002897 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1be74142-b864-439c-b9bf-2fdf085c3c48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:31.010890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1be74142-b864-439c-b9bf-2fdf085c3c48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:31.011387 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1be74142-b864-439c-b9bf-2fdf085c3c48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:31.012251 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1be74142-b864-439c-b9bf-2fdf085c3c48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:31.012729 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1be74142-b864-439c-b9bf-2fdf085c3c48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:31.153680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1be74142-b864-439c-b9bf-2fdf085c3c48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 14 microversion: 2.20 time: 0.155581 Feb 17 03:32:31.157127 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 440/830] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:30 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:31.826231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-da894471-6353-4198-9108-27a5a07b7ea4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:31.834252 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-da894471-6353-4198-9108-27a5a07b7ea4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] [instance: 9c24f4ad-6fbd-441f-8a47-4ca0b607824b] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:31.846999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-da894471-6353-4198-9108-27a5a07b7ea4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:31.848244 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-da894471-6353-4198-9108-27a5a07b7ea4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:31.849711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-da894471-6353-4198-9108-27a5a07b7ea4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:31.850657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-da894471-6353-4198-9108-27a5a07b7ea4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:31.926810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-da894471-6353-4198-9108-27a5a07b7ea4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] HTTP exception thrown: Instance 9c24f4ad-6fbd-441f-8a47-4ca0b607824b could not be found. Feb 17 03:32:31.927476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-da894471-6353-4198-9108-27a5a07b7ea4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] Returning 404 to user: Instance 9c24f4ad-6fbd-441f-8a47-4ca0b607824b could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:32:31.928406 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-da894471-6353-4198-9108-27a5a07b7ea4 tempest-VolumesNegativeTest-1459138443 tempest-VolumesNegativeTest-1459138443-project] 10.222.0.46 "GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b" status: 404 len: 111 microversion: 2.1 time: 0.107017 Feb 17 03:32:31.929323 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 391/831] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:31 2021] GET /compute/v2.1/servers/9c24f4ad-6fbd-441f-8a47-4ca0b607824b => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:32:32.169934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-17318652-6b5b-4782-b7ca-2d7bc7c8d00c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:32.170769 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-17318652-6b5b-4782-b7ca-2d7bc7c8d00c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:32.184264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-17318652-6b5b-4782-b7ca-2d7bc7c8d00c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:32.184264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-17318652-6b5b-4782-b7ca-2d7bc7c8d00c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:32.185137 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-17318652-6b5b-4782-b7ca-2d7bc7c8d00c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:32.185624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-17318652-6b5b-4782-b7ca-2d7bc7c8d00c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:32.329230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-17318652-6b5b-4782-b7ca-2d7bc7c8d00c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 14 microversion: 2.20 time: 0.167269 Feb 17 03:32:32.332768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 441/832] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:32 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:32.879486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-116efb7c-ca58-46e0-a50f-1ee02644506f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:32.880065 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-116efb7c-ca58-46e0-a50f-1ee02644506f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:32.888522 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-116efb7c-ca58-46e0-a50f-1ee02644506f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:32.889283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-116efb7c-ca58-46e0-a50f-1ee02644506f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:32.890329 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-116efb7c-ca58-46e0-a50f-1ee02644506f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:32.890960 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-116efb7c-ca58-46e0-a50f-1ee02644506f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:32.958251 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-116efb7c-ca58-46e0-a50f-1ee02644506f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Going to try to terminate instance {{(pid=98184) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:32:33.089442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-116efb7c-ca58-46e0-a50f-1ee02644506f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "DELETE /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 204 len: 0 microversion: 2.1 time: 0.213507 Feb 17 03:32:33.090104 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 392/833] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:32:32 2021] DELETE /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:32:33.099525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4405353b-ff55-4189-a5ee-96bbc6168efa tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:33.100799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4405353b-ff55-4189-a5ee-96bbc6168efa tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:33.109780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4405353b-ff55-4189-a5ee-96bbc6168efa tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:33.110272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4405353b-ff55-4189-a5ee-96bbc6168efa tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:33.111092 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4405353b-ff55-4189-a5ee-96bbc6168efa tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:33.111598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4405353b-ff55-4189-a5ee-96bbc6168efa tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:33.333452 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4405353b-ff55-4189-a5ee-96bbc6168efa tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:33.342887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b0cd2a78-e18e-4f49-af37-799145d7025d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:33.343992 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b0cd2a78-e18e-4f49-af37-799145d7025d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:33.344119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4405353b-ff55-4189-a5ee-96bbc6168efa tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1674 microversion: 2.1 time: 0.248954 Feb 17 03:32:33.344626 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 442/834] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:33 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1674 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:33.365117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0cd2a78-e18e-4f49-af37-799145d7025d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:33.365625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0cd2a78-e18e-4f49-af37-799145d7025d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:33.366466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0cd2a78-e18e-4f49-af37-799145d7025d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:33.367196 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0cd2a78-e18e-4f49-af37-799145d7025d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:33.527458 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b0cd2a78-e18e-4f49-af37-799145d7025d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 14 microversion: 2.20 time: 0.190207 Feb 17 03:32:33.528242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 393/835] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:33 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:34.362704 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3039df8d-9f56-4ffc-8e43-7023e080fd27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:34.363367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3039df8d-9f56-4ffc-8e43-7023e080fd27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:34.372142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3039df8d-9f56-4ffc-8e43-7023e080fd27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:34.372650 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3039df8d-9f56-4ffc-8e43-7023e080fd27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:34.373506 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3039df8d-9f56-4ffc-8e43-7023e080fd27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:34.373997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3039df8d-9f56-4ffc-8e43-7023e080fd27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:34.539970 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8d9ee89e-727d-4b66-9ebf-b3fe6cdb7080 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:34.544228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8d9ee89e-727d-4b66-9ebf-b3fe6cdb7080 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:34.553713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8d9ee89e-727d-4b66-9ebf-b3fe6cdb7080 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:34.554349 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8d9ee89e-727d-4b66-9ebf-b3fe6cdb7080 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:34.555300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8d9ee89e-727d-4b66-9ebf-b3fe6cdb7080 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:34.555945 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8d9ee89e-727d-4b66-9ebf-b3fe6cdb7080 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:34.615843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3039df8d-9f56-4ffc-8e43-7023e080fd27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:34.627841 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3039df8d-9f56-4ffc-8e43-7023e080fd27 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1674 microversion: 2.1 time: 0.269112 Feb 17 03:32:34.628439 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 443/836] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:34 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1674 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:34.690184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8d9ee89e-727d-4b66-9ebf-b3fe6cdb7080 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 14 microversion: 2.20 time: 0.155133 Feb 17 03:32:34.693787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 394/837] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:34 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:35.393164 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-151ba11b-7f78-4397-a047-94a936566a7c req-3c5164de-a65c-401f-bce1-637f312529f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415389d3-caaf-4b28-9090-426e4fe11633", "name": "network-vif-unplugged", "status": "completed", "tag": "2de00b31-a873-47bd-8a1b-654da9855749"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:35.395688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:35.395688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:35.405747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-151ba11b-7f78-4397-a047-94a936566a7c req-3c5164de-a65c-401f-bce1-637f312529f6 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.408531 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-151ba11b-7f78-4397-a047-94a936566a7c req-3c5164de-a65c-401f-bce1-637f312529f6 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.428643 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-151ba11b-7f78-4397-a047-94a936566a7c req-3c5164de-a65c-401f-bce1-637f312529f6 service nova] Creating event network-vif-unplugged:2de00b31-a873-47bd-8a1b-654da9855749 for instance 415389d3-caaf-4b28-9090-426e4fe11633 on hv-cinder-75996 Feb 17 03:32:35.434407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-151ba11b-7f78-4397-a047-94a936566a7c req-3c5164de-a65c-401f-bce1-637f312529f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044843 Feb 17 03:32:35.435350 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 444/838] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:35 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:35.646959 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9afc98ee-ce20-4c9d-acca-4c06da3b7656 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:35.647759 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9afc98ee-ce20-4c9d-acca-4c06da3b7656 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:35.657045 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9afc98ee-ce20-4c9d-acca-4c06da3b7656 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.657555 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9afc98ee-ce20-4c9d-acca-4c06da3b7656 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.658432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9afc98ee-ce20-4c9d-acca-4c06da3b7656 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.658931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9afc98ee-ce20-4c9d-acca-4c06da3b7656 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.702189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6ffcae1d-c62d-42c8-9f9b-1b06812efda3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:35.703299 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6ffcae1d-c62d-42c8-9f9b-1b06812efda3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:35.711173 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6ffcae1d-c62d-42c8-9f9b-1b06812efda3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.711694 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6ffcae1d-c62d-42c8-9f9b-1b06812efda3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.713150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6ffcae1d-c62d-42c8-9f9b-1b06812efda3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.713635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6ffcae1d-c62d-42c8-9f9b-1b06812efda3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.843193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6ffcae1d-c62d-42c8-9f9b-1b06812efda3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 14 microversion: 2.20 time: 0.145602 Feb 17 03:32:35.846814 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 445/839] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:35 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:35.889195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9afc98ee-ce20-4c9d-acca-4c06da3b7656 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:35.898092 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9afc98ee-ce20-4c9d-acca-4c06da3b7656 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1674 microversion: 2.1 time: 0.255691 Feb 17 03:32:35.898685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 395/840] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:35 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:36.856406 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-524db7c5-94e6-440c-ac86-4aad8f65d927 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:36.857813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-524db7c5-94e6-440c-ac86-4aad8f65d927 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:36.866456 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-524db7c5-94e6-440c-ac86-4aad8f65d927 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:36.866972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-524db7c5-94e6-440c-ac86-4aad8f65d927 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:36.867877 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-524db7c5-94e6-440c-ac86-4aad8f65d927 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:36.868364 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-524db7c5-94e6-440c-ac86-4aad8f65d927 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:36.916584 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-33db3ac8-8f73-490d-9a11-7e70355adcf6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:36.917613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-33db3ac8-8f73-490d-9a11-7e70355adcf6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:36.928545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-33db3ac8-8f73-490d-9a11-7e70355adcf6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:36.929377 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-33db3ac8-8f73-490d-9a11-7e70355adcf6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:36.930441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-33db3ac8-8f73-490d-9a11-7e70355adcf6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:36.931168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-33db3ac8-8f73-490d-9a11-7e70355adcf6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:37.026379 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-524db7c5-94e6-440c-ac86-4aad8f65d927 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 14 microversion: 2.20 time: 0.174026 Feb 17 03:32:37.027272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 446/841] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:36 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:37.088949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-33db3ac8-8f73-490d-9a11-7e70355adcf6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:37.098269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-33db3ac8-8f73-490d-9a11-7e70355adcf6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1606 microversion: 2.1 time: 0.185648 Feb 17 03:32:37.099026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 396/842] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:36 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1606 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:37.713952 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-d5751c04-a7cd-4ad9-b5a2-0acd27f773e7 req-803c53fe-9074-4d6c-ad2f-3583ee55fd50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415389d3-caaf-4b28-9090-426e4fe11633", "name": "network-vif-deleted", "tag": "2de00b31-a873-47bd-8a1b-654da9855749"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:37.716348 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:37.716348 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:37.729417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-d5751c04-a7cd-4ad9-b5a2-0acd27f773e7 req-803c53fe-9074-4d6c-ad2f-3583ee55fd50 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:37.730036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-d5751c04-a7cd-4ad9-b5a2-0acd27f773e7 req-803c53fe-9074-4d6c-ad2f-3583ee55fd50 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:37.755061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-d5751c04-a7cd-4ad9-b5a2-0acd27f773e7 req-803c53fe-9074-4d6c-ad2f-3583ee55fd50 service nova] Creating event network-vif-deleted:2de00b31-a873-47bd-8a1b-654da9855749 for instance 415389d3-caaf-4b28-9090-426e4fe11633 on hv-cinder-75996 Feb 17 03:32:37.761016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-d5751c04-a7cd-4ad9-b5a2-0acd27f773e7 req-803c53fe-9074-4d6c-ad2f-3583ee55fd50 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051530 Feb 17 03:32:37.762081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 447/843] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:38.037935 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-edd8abb8-e584-480a-bd67-4005ec6fabb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:38.039080 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-edd8abb8-e584-480a-bd67-4005ec6fabb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:38.048004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-edd8abb8-e584-480a-bd67-4005ec6fabb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:38.048513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-edd8abb8-e584-480a-bd67-4005ec6fabb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:38.049353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-edd8abb8-e584-480a-bd67-4005ec6fabb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:38.049838 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-edd8abb8-e584-480a-bd67-4005ec6fabb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:38.118126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d54bcec7-b0d9-4b5a-b10a-40b629f18b64 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:38.118931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d54bcec7-b0d9-4b5a-b10a-40b629f18b64 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:38.127229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d54bcec7-b0d9-4b5a-b10a-40b629f18b64 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:38.127763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d54bcec7-b0d9-4b5a-b10a-40b629f18b64 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:38.128590 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d54bcec7-b0d9-4b5a-b10a-40b629f18b64 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:38.129072 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d54bcec7-b0d9-4b5a-b10a-40b629f18b64 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:38.184287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-edd8abb8-e584-480a-bd67-4005ec6fabb6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 14 microversion: 2.20 time: 0.150110 Feb 17 03:32:38.187921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 397/844] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:38 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:38.205959 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d54bcec7-b0d9-4b5a-b10a-40b629f18b64 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:38.206469 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d54bcec7-b0d9-4b5a-b10a-40b629f18b64 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:38.206982 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-d54bcec7-b0d9-4b5a-b10a-40b629f18b64 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lazy-loading 'fault' on Instance uuid 415389d3-caaf-4b28-9090-426e4fe11633 {{(pid=98183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:32:38.287346 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d54bcec7-b0d9-4b5a-b10a-40b629f18b64 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:38.297729 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d54bcec7-b0d9-4b5a-b10a-40b629f18b64 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 200 len: 1327 microversion: 2.1 time: 0.184231 Feb 17 03:32:38.298500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 448/845] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:38 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 1327 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:39.199906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-865dfc2f-8d43-4e01-9dbd-82178c166cf8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:39.199906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-865dfc2f-8d43-4e01-9dbd-82178c166cf8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:39.207874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-865dfc2f-8d43-4e01-9dbd-82178c166cf8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.209022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-865dfc2f-8d43-4e01-9dbd-82178c166cf8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.210288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-865dfc2f-8d43-4e01-9dbd-82178c166cf8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.211027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-865dfc2f-8d43-4e01-9dbd-82178c166cf8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.316351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b67a8ac6-351b-4822-aece-635861c57877 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:39.317040 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b67a8ac6-351b-4822-aece-635861c57877 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:39.326105 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b67a8ac6-351b-4822-aece-635861c57877 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.326699 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b67a8ac6-351b-4822-aece-635861c57877 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.327658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b67a8ac6-351b-4822-aece-635861c57877 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.328253 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b67a8ac6-351b-4822-aece-635861c57877 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.358878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-865dfc2f-8d43-4e01-9dbd-82178c166cf8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 6451 microversion: 2.20 time: 0.166700 Feb 17 03:32:39.359962 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 398/846] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:39 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 6451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:39.382158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-b67a8ac6-351b-4822-aece-635861c57877 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] HTTP exception thrown: Instance 415389d3-caaf-4b28-9090-426e4fe11633 could not be found. Feb 17 03:32:39.382823 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b67a8ac6-351b-4822-aece-635861c57877 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Returning 404 to user: Instance 415389d3-caaf-4b28-9090-426e4fe11633 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:32:39.383769 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b67a8ac6-351b-4822-aece-635861c57877 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 404 len: 111 microversion: 2.1 time: 0.071482 Feb 17 03:32:39.384440 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 449/847] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:39 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:32:39.394143 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1bd75b90-a173-42db-bb0b-ec9d8381b52a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '.version_select at 0x7f012da6a378>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:39.412957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1bd75b90-a173-42db-bb0b-ec9d8381b52a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425365291" status: 202 len: 0 microversion: 2.1 time: 0.023329 Feb 17 03:32:39.413602 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 399/848] 10.222.0.46 () {58 vars in 1211 bytes} [Wed Feb 17 03:32:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425365291 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:40.371670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-68e23da9-45f8-4ad3-a66e-5699f0a342a3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:40.372710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-68e23da9-45f8-4ad3-a66e-5699f0a342a3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:40.380754 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-68e23da9-45f8-4ad3-a66e-5699f0a342a3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:40.381254 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-68e23da9-45f8-4ad3-a66e-5699f0a342a3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:40.382085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-68e23da9-45f8-4ad3-a66e-5699f0a342a3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:40.382565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-68e23da9-45f8-4ad3-a66e-5699f0a342a3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:40.534156 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-68e23da9-45f8-4ad3-a66e-5699f0a342a3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 14203 microversion: 2.20 time: 0.166813 Feb 17 03:32:40.535091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 450/849] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:40 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 14203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:40.774762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d6ec2442-6573-4425-b4f0-5eda79b297ae tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'create', calling method: .version_select at 0x7f012da6abf8>, body: {"keypair": {"name": "tempest-keypair-2144542529"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:40.806824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-d6ec2442-6573-4425-b4f0-5eda79b297ae tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Getting quotas for project 540aff79a2694839aada97949939da9c. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:32:40.813030 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-d6ec2442-6573-4425-b4f0-5eda79b297ae tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Getting quotas for user aa461b9b5c574c16b33c3da000b65f14 and project 540aff79a2694839aada97949939da9c. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:32:40.989547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-d6ec2442-6573-4425-b4f0-5eda79b297ae tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Getting quotas for project 540aff79a2694839aada97949939da9c. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:32:40.993524 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-d6ec2442-6573-4425-b4f0-5eda79b297ae tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Getting quotas for user aa461b9b5c574c16b33c3da000b65f14 and project 540aff79a2694839aada97949939da9c. Resources: {'key_pairs'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:32:41.006891 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d6ec2442-6573-4425-b4f0-5eda79b297ae tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.236705 Feb 17 03:32:41.007573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 400/850] 10.222.0.46 () {60 vars in 1148 bytes} [Wed Feb 17 03:32:40 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:41.550879 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2529da77-4273-4d47-87c7-42a1aa5480d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:41.552318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2529da77-4273-4d47-87c7-42a1aa5480d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:41.561978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2529da77-4273-4d47-87c7-42a1aa5480d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:41.562478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2529da77-4273-4d47-87c7-42a1aa5480d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:41.563320 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2529da77-4273-4d47-87c7-42a1aa5480d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:41.563833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2529da77-4273-4d47-87c7-42a1aa5480d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:41.695717 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2529da77-4273-4d47-87c7-42a1aa5480d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 18155 microversion: 2.20 time: 0.149411 Feb 17 03:32:41.696428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 451/851] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:41 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 18155 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:42.708503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e440f4e9-186e-49df-b750-1fc936ee785b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:42.709740 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e440f4e9-186e-49df-b750-1fc936ee785b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:42.717805 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e440f4e9-186e-49df-b750-1fc936ee785b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:42.718308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e440f4e9-186e-49df-b750-1fc936ee785b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:42.719139 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e440f4e9-186e-49df-b750-1fc936ee785b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:42.719682 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e440f4e9-186e-49df-b750-1fc936ee785b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:42.886336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e440f4e9-186e-49df-b750-1fc936ee785b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 18305 microversion: 2.20 time: 0.182018 Feb 17 03:32:42.890352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 401/852] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:42 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 18305 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:43.757894 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-621478084", "imageRef": "16751d63-c261-4f09-a4ac-a246107f0682", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aaca52fc-20e8-4f1e-a4a1-2b3bb58459da"}], "security_groups": [{"name": "tempest-securitygroup--1777573992"}], "key_name": "tempest-keypair-2144542529", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:43.893302 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] validate_networks() for [('aaca52fc-20e8-4f1e-a4a1-2b3bb58459da', None, None, None)] {{(pid=98183) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:32:43.902444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-506321e9-85ab-4aa1-b962-101d4742e98a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:43.903658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-506321e9-85ab-4aa1-b962-101d4742e98a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:43.912335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-506321e9-85ab-4aa1-b962-101d4742e98a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:43.912842 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-506321e9-85ab-4aa1-b962-101d4742e98a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:43.913679 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-506321e9-85ab-4aa1-b962-101d4742e98a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:43.914171 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-506321e9-85ab-4aa1-b962-101d4742e98a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:44.067774 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-506321e9-85ab-4aa1-b962-101d4742e98a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 20833 microversion: 2.20 time: 0.170331 Feb 17 03:32:44.069507 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 402/853] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:43 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 20833 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:44.605639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Flavor limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:32:44.606107 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Image limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:32:44.606642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Flavor pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:32:44.607092 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Image pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:32:44.607642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:32:44.616424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:44.616916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:44.617781 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:44.618264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:44.637359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Getting quotas for project 540aff79a2694839aada97949939da9c. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:32:44.641672 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Getting quotas for user aa461b9b5c574c16b33c3da000b65f14 and project 540aff79a2694839aada97949939da9c. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:32:44.653291 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Going to run 1 instances... {{(pid=98183) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:32:44.655969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16751d63-c261-4f09-a4ac-a246107f0682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:32:44.706884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c6a45a74-04c3-484c-ab4b-40ba2befc914 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.954028 Feb 17 03:32:44.707624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 452/854] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:32:43 2021] POST /compute/v2.1/servers => generated 402 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:32:44.722447 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6250e805-6269-4497-bc7b-8268fa49cd19 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:44.723209 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6250e805-6269-4497-bc7b-8268fa49cd19 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:44.821475 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6250e805-6269-4497-bc7b-8268fa49cd19 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:44.832417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6250e805-6269-4497-bc7b-8268fa49cd19 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1237 microversion: 2.1 time: 0.114277 Feb 17 03:32:44.833245 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 403/855] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:44 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1237 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:45.080254 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-aade48ea-2977-4902-9600-b7c765d3e383 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:45.081412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-aade48ea-2977-4902-9600-b7c765d3e383 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:45.091455 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aade48ea-2977-4902-9600-b7c765d3e383 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:45.091982 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aade48ea-2977-4902-9600-b7c765d3e383 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:45.092852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aade48ea-2977-4902-9600-b7c765d3e383 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:45.093332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aade48ea-2977-4902-9600-b7c765d3e383 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:45.267554 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-aade48ea-2977-4902-9600-b7c765d3e383 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 22772 microversion: 2.20 time: 0.191753 Feb 17 03:32:45.268264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 453/856] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:45 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 22772 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:45.869586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b1b360ad-9537-4aca-873e-5df71a66566c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:45.870248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b1b360ad-9537-4aca-873e-5df71a66566c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:45.879390 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1b360ad-9537-4aca-873e-5df71a66566c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:45.879939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1b360ad-9537-4aca-873e-5df71a66566c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:45.880775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1b360ad-9537-4aca-873e-5df71a66566c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:45.881266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b1b360ad-9537-4aca-873e-5df71a66566c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:46.034255 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b1b360ad-9537-4aca-873e-5df71a66566c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:46.044052 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b1b360ad-9537-4aca-873e-5df71a66566c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1289 microversion: 2.1 time: 0.178906 Feb 17 03:32:46.044673 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 404/857] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:45 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1289 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:46.282555 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-535a69eb-593d-42d6-8e9f-2217caf89e3d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:46.283767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-535a69eb-593d-42d6-8e9f-2217caf89e3d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:46.292954 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-535a69eb-593d-42d6-8e9f-2217caf89e3d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:46.293442 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-535a69eb-593d-42d6-8e9f-2217caf89e3d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:46.294450 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-535a69eb-593d-42d6-8e9f-2217caf89e3d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:46.295093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-535a69eb-593d-42d6-8e9f-2217caf89e3d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:46.474131 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-535a69eb-593d-42d6-8e9f-2217caf89e3d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 23803 microversion: 2.20 time: 0.196962 Feb 17 03:32:46.479166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 454/858] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:46 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 23803 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:47.063130 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ea6dd708-f5aa-4d57-b0b2-7be210d00f21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:47.063938 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ea6dd708-f5aa-4d57-b0b2-7be210d00f21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:47.075195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ea6dd708-f5aa-4d57-b0b2-7be210d00f21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.075739 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ea6dd708-f5aa-4d57-b0b2-7be210d00f21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.076586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ea6dd708-f5aa-4d57-b0b2-7be210d00f21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.077076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ea6dd708-f5aa-4d57-b0b2-7be210d00f21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.305844 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ea6dd708-f5aa-4d57-b0b2-7be210d00f21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:47.316870 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ea6dd708-f5aa-4d57-b0b2-7be210d00f21 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1363 microversion: 2.1 time: 0.257637 Feb 17 03:32:47.324692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 405/859] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:47 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:47.487479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fd8368d8-2125-452e-889b-40e6374ecf26 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:47.488726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fd8368d8-2125-452e-889b-40e6374ecf26 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:47.498874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd8368d8-2125-452e-889b-40e6374ecf26 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.499727 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd8368d8-2125-452e-889b-40e6374ecf26 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.500790 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd8368d8-2125-452e-889b-40e6374ecf26 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.501492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd8368d8-2125-452e-889b-40e6374ecf26 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.632817 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fd8368d8-2125-452e-889b-40e6374ecf26 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 23803 microversion: 2.20 time: 0.149573 Feb 17 03:32:47.634703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 455/860] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:47 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 23803 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:48.342495 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7134ed38-3ddb-4450-8209-e7304d4aa06c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:48.343165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7134ed38-3ddb-4450-8209-e7304d4aa06c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:48.351537 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7134ed38-3ddb-4450-8209-e7304d4aa06c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:48.352048 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7134ed38-3ddb-4450-8209-e7304d4aa06c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:48.353393 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7134ed38-3ddb-4450-8209-e7304d4aa06c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:48.353885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7134ed38-3ddb-4450-8209-e7304d4aa06c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:48.618637 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7134ed38-3ddb-4450-8209-e7304d4aa06c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:48.631841 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7134ed38-3ddb-4450-8209-e7304d4aa06c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1363 microversion: 2.1 time: 0.293034 Feb 17 03:32:48.632846 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 406/861] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:48 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:48.648456 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ca4ba8ed-962f-4837-879f-070f7da9915b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:48.650370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ca4ba8ed-962f-4837-879f-070f7da9915b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:48.659452 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ca4ba8ed-962f-4837-879f-070f7da9915b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:48.660279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ca4ba8ed-962f-4837-879f-070f7da9915b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:48.661343 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ca4ba8ed-962f-4837-879f-070f7da9915b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:48.662039 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ca4ba8ed-962f-4837-879f-070f7da9915b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:48.799991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ca4ba8ed-962f-4837-879f-070f7da9915b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 24641 microversion: 2.20 time: 0.155535 Feb 17 03:32:48.801210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 456/862] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:48 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 24641 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:48.900409 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1965616026", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1857685246", "security_groups": [{"name": "tempest-TestVolumeBootPattern-2001516187"}], "block_device_mapping_v2": [{"uuid": "d3cc0687-e522-4506-83bf-ff2cf2b0f548", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4e746511-e0b4-40cf-9f26-4fcf068fda47"}]}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:49.097929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] validate_networks() for [('4e746511-e0b4-40cf-9f26-4fcf068fda47', None, None, None)] {{(pid=98184) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:32:49.184201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-9c2e0c4b-b335-411f-aa69-e064e5ee6c23 req-b3f7a0bb-2392-498a-98bb-bf3895a3b7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73390732-5d83-45e6-a650-228f06ea5210", "tag": "493bd038-841b-4470-a3d9-cbec3c0afcd9"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:49.185866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:49.185866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:49.196138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-9c2e0c4b-b335-411f-aa69-e064e5ee6c23 req-b3f7a0bb-2392-498a-98bb-bf3895a3b7c3 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:49.196669 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-9c2e0c4b-b335-411f-aa69-e064e5ee6c23 req-b3f7a0bb-2392-498a-98bb-bf3895a3b7c3 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:49.236430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-9c2e0c4b-b335-411f-aa69-e064e5ee6c23 req-b3f7a0bb-2392-498a-98bb-bf3895a3b7c3 service nova] Creating event network-changed:493bd038-841b-4470-a3d9-cbec3c0afcd9 for instance 73390732-5d83-45e6-a650-228f06ea5210 on hv-cinder-75996 Feb 17 03:32:49.244647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-9c2e0c4b-b335-411f-aa69-e064e5ee6c23 req-b3f7a0bb-2392-498a-98bb-bf3895a3b7c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065476 Feb 17 03:32:49.245301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 457/863] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:49.652247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-45951055-537a-4e15-a3af-9c730dd32844 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:49.653608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-45951055-537a-4e15-a3af-9c730dd32844 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:49.661757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45951055-537a-4e15-a3af-9c730dd32844 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:49.662268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45951055-537a-4e15-a3af-9c730dd32844 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:49.663104 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45951055-537a-4e15-a3af-9c730dd32844 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:49.663759 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45951055-537a-4e15-a3af-9c730dd32844 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:49.962905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Flavor limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:32:49.963297 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Image limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:32:49.963969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Flavor pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:32:49.964430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Image pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:32:49.964890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:32:49.974095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:49.974605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:49.975779 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:49.976273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:49.995341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Getting quotas for project fce55aed27e14d6791193d35e5ac2137. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:32:50.000751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Getting quotas for user a08274bcef1c4e73a39e60b3a11b09d1 and project fce55aed27e14d6791193d35e5ac2137. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:32:50.049405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-45951055-537a-4e15-a3af-9c730dd32844 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:50.059149 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-45951055-537a-4e15-a3af-9c730dd32844 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1363 microversion: 2.1 time: 0.412514 Feb 17 03:32:50.059799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 458/864] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:49 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1363 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:50.067943 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-14eda696-b317-42f2-94ba-ed2319ff348c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:50.069804 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-14eda696-b317-42f2-94ba-ed2319ff348c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:50.078454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14eda696-b317-42f2-94ba-ed2319ff348c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:50.078957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14eda696-b317-42f2-94ba-ed2319ff348c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:50.079907 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14eda696-b317-42f2-94ba-ed2319ff348c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:50.080395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14eda696-b317-42f2-94ba-ed2319ff348c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:50.111063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Going to run 1 instances... {{(pid=98184) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:32:50.115216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3cc0687-e522-4506-83bf-ff2cf2b0f548',volume_size=None,volume_type=None)] {{(pid=98184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:32:50.216102 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-14eda696-b317-42f2-94ba-ed2319ff348c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 26550 microversion: 2.20 time: 0.154005 Feb 17 03:32:50.219565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 459/865] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:50 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 26550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:50.311555 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fe928a54-394a-409d-9971-09a44e6de7a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.415724 Feb 17 03:32:50.318449 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 407/866] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:32:48 2021] POST /compute/v2.1/servers => generated 413 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:32:50.325253 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-92ad1d51-a739-4e98-b31a-bb8a4eccd804 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:50.326116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-92ad1d51-a739-4e98-b31a-bb8a4eccd804 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:50.453818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-92ad1d51-a739-4e98-b31a-bb8a4eccd804 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:50.462281 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-92ad1d51-a739-4e98-b31a-bb8a4eccd804 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1095 microversion: 2.1 time: 0.142205 Feb 17 03:32:50.463106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 460/867] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:50 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1095 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:51.078379 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2db2ebf2-61dc-466a-8b7c-31f2ff32c9e3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:51.079749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2db2ebf2-61dc-466a-8b7c-31f2ff32c9e3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:51.092387 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2db2ebf2-61dc-466a-8b7c-31f2ff32c9e3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:51.092916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2db2ebf2-61dc-466a-8b7c-31f2ff32c9e3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.093761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2db2ebf2-61dc-466a-8b7c-31f2ff32c9e3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:51.094246 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2db2ebf2-61dc-466a-8b7c-31f2ff32c9e3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.229165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d7358271-7aac-412f-8b09-6784fac35d7d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:51.230485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d7358271-7aac-412f-8b09-6784fac35d7d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:51.239272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7358271-7aac-412f-8b09-6784fac35d7d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:51.239870 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7358271-7aac-412f-8b09-6784fac35d7d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.240701 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7358271-7aac-412f-8b09-6784fac35d7d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:51.241176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d7358271-7aac-412f-8b09-6784fac35d7d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.375083 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2db2ebf2-61dc-466a-8b7c-31f2ff32c9e3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:51.383881 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2db2ebf2-61dc-466a-8b7c-31f2ff32c9e3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1363 microversion: 2.1 time: 0.309633 Feb 17 03:32:51.384993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 408/868] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:51 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:51.411553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d7358271-7aac-412f-8b09-6784fac35d7d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 27372 microversion: 2.20 time: 0.186314 Feb 17 03:32:51.412261 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 461/869] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:51 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 27372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:51.480522 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d2980325-4b41-47dc-9f72-e665e062fad4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:51.481227 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d2980325-4b41-47dc-9f72-e665e062fad4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:51.489434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d2980325-4b41-47dc-9f72-e665e062fad4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:51.490038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d2980325-4b41-47dc-9f72-e665e062fad4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.490849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d2980325-4b41-47dc-9f72-e665e062fad4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:51.491381 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d2980325-4b41-47dc-9f72-e665e062fad4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.624597 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d2980325-4b41-47dc-9f72-e665e062fad4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:51.634845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d2980325-4b41-47dc-9f72-e665e062fad4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1193 microversion: 2.1 time: 0.157893 Feb 17 03:32:51.635464 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 409/870] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:51 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1193 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:52.403527 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f297ac76-06e7-41d3-90b1-1cff955d08e0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:52.404448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f297ac76-06e7-41d3-90b1-1cff955d08e0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:52.414720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f297ac76-06e7-41d3-90b1-1cff955d08e0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:52.415229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f297ac76-06e7-41d3-90b1-1cff955d08e0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:52.416109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f297ac76-06e7-41d3-90b1-1cff955d08e0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:52.416606 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f297ac76-06e7-41d3-90b1-1cff955d08e0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:52.424262 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0dc90bd2-28e7-4dff-9d0f-63e4480ea7bb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:52.425391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0dc90bd2-28e7-4dff-9d0f-63e4480ea7bb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:52.438121 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0dc90bd2-28e7-4dff-9d0f-63e4480ea7bb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:52.438633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0dc90bd2-28e7-4dff-9d0f-63e4480ea7bb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:52.439563 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0dc90bd2-28e7-4dff-9d0f-63e4480ea7bb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:52.440058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0dc90bd2-28e7-4dff-9d0f-63e4480ea7bb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:52.591136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0dc90bd2-28e7-4dff-9d0f-63e4480ea7bb tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 27924 microversion: 2.20 time: 0.170789 Feb 17 03:32:52.595315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 410/871] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:52 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 27924 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:52.660834 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f297ac76-06e7-41d3-90b1-1cff955d08e0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:52.672774 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f297ac76-06e7-41d3-90b1-1cff955d08e0 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1363 microversion: 2.1 time: 0.273814 Feb 17 03:32:52.673229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-571a5347-f734-4134-9bfb-61f0724001c0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:52.673490 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 462/872] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:52 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:52.673988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-571a5347-f734-4134-9bfb-61f0724001c0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:52.685100 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-571a5347-f734-4134-9bfb-61f0724001c0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:52.685617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-571a5347-f734-4134-9bfb-61f0724001c0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:52.686480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-571a5347-f734-4134-9bfb-61f0724001c0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:52.686978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-571a5347-f734-4134-9bfb-61f0724001c0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:52.928582 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-571a5347-f734-4134-9bfb-61f0724001c0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:52.938917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-571a5347-f734-4134-9bfb-61f0724001c0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1286 microversion: 2.1 time: 0.287014 Feb 17 03:32:52.939710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 411/873] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:52 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1286 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:53.603605 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6f49f1ce-124e-4a28-abf2-68381b0e59ac tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:53.604623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6f49f1ce-124e-4a28-abf2-68381b0e59ac tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:53.612867 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6f49f1ce-124e-4a28-abf2-68381b0e59ac tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:53.613361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6f49f1ce-124e-4a28-abf2-68381b0e59ac tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:53.614187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6f49f1ce-124e-4a28-abf2-68381b0e59ac tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:53.614673 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6f49f1ce-124e-4a28-abf2-68381b0e59ac tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:53.691484 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5d6b96dd-aac7-44d7-a149-e55951be1696 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:53.692166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5d6b96dd-aac7-44d7-a149-e55951be1696 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:53.700419 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5d6b96dd-aac7-44d7-a149-e55951be1696 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:53.700925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5d6b96dd-aac7-44d7-a149-e55951be1696 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:53.701755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5d6b96dd-aac7-44d7-a149-e55951be1696 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:53.702247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5d6b96dd-aac7-44d7-a149-e55951be1696 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:53.759569 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6f49f1ce-124e-4a28-abf2-68381b0e59ac tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 28217 microversion: 2.20 time: 0.160403 Feb 17 03:32:53.761276 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 463/874] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:53 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 28217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:53.924195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5d6b96dd-aac7-44d7-a149-e55951be1696 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:53.933404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5d6b96dd-aac7-44d7-a149-e55951be1696 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1363 microversion: 2.1 time: 0.245802 Feb 17 03:32:53.934012 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 412/875] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:53 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:53.961373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-84bbb5f5-f0ec-4de0-afa9-d154af378f4c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:53.962966 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-84bbb5f5-f0ec-4de0-afa9-d154af378f4c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:53.971848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-84bbb5f5-f0ec-4de0-afa9-d154af378f4c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:53.973270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-84bbb5f5-f0ec-4de0-afa9-d154af378f4c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:53.973405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-84bbb5f5-f0ec-4de0-afa9-d154af378f4c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:53.973806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-84bbb5f5-f0ec-4de0-afa9-d154af378f4c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:54.218693 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-84bbb5f5-f0ec-4de0-afa9-d154af378f4c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:54.228779 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-84bbb5f5-f0ec-4de0-afa9-d154af378f4c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1274 microversion: 2.1 time: 0.271985 Feb 17 03:32:54.235706 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 464/876] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:53 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1274 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:54.257165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-52b55359-8ee9-4648-905b-0f0079500dde req-fc3a845d-2513-4bc5-9f59-9ed90215f215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73390732-5d83-45e6-a650-228f06ea5210", "name": "network-vif-plugged", "status": "completed", "tag": "493bd038-841b-4470-a3d9-cbec3c0afcd9"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:54.258937 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:54.258937 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:54.269195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-52b55359-8ee9-4648-905b-0f0079500dde req-fc3a845d-2513-4bc5-9f59-9ed90215f215 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:54.269691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-52b55359-8ee9-4648-905b-0f0079500dde req-fc3a845d-2513-4bc5-9f59-9ed90215f215 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:54.304341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-52b55359-8ee9-4648-905b-0f0079500dde req-fc3a845d-2513-4bc5-9f59-9ed90215f215 service nova] Creating event network-vif-plugged:493bd038-841b-4470-a3d9-cbec3c0afcd9 for instance 73390732-5d83-45e6-a650-228f06ea5210 on hv-cinder-75996 Feb 17 03:32:54.309996 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-52b55359-8ee9-4648-905b-0f0079500dde req-fc3a845d-2513-4bc5-9f59-9ed90215f215 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061060 Feb 17 03:32:54.310872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 413/877] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:54.761295 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-52da36ff-603e-43b6-97f5-fcadd5534258 req-8a9faea2-8c99-4be4-8275-f2293c9aed68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09664edd-5f9f-4b5e-b7b1-06857eff4d59", "tag": "35520748-b121-42ff-b9ac-e966407e4668"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:54.763420 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:54.763420 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:54.774624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-12cac34a-8462-4097-94cd-7214d7dbb3d6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:54.775789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-12cac34a-8462-4097-94cd-7214d7dbb3d6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:54.784690 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-52da36ff-603e-43b6-97f5-fcadd5534258 req-8a9faea2-8c99-4be4-8275-f2293c9aed68 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:54.785225 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-52da36ff-603e-43b6-97f5-fcadd5534258 req-8a9faea2-8c99-4be4-8275-f2293c9aed68 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:54.796798 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-12cac34a-8462-4097-94cd-7214d7dbb3d6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:54.798082 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-12cac34a-8462-4097-94cd-7214d7dbb3d6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:54.798275 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-12cac34a-8462-4097-94cd-7214d7dbb3d6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:54.798944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-12cac34a-8462-4097-94cd-7214d7dbb3d6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:54.807331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-52da36ff-603e-43b6-97f5-fcadd5534258 req-8a9faea2-8c99-4be4-8275-f2293c9aed68 service nova] Creating event network-changed:35520748-b121-42ff-b9ac-e966407e4668 for instance 09664edd-5f9f-4b5e-b7b1-06857eff4d59 on hv-cinder-75996 Feb 17 03:32:54.814838 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-52da36ff-603e-43b6-97f5-fcadd5534258 req-8a9faea2-8c99-4be4-8275-f2293c9aed68 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059061 Feb 17 03:32:54.815668 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 465/878] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:32:54.952890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f8a8e3e1-df22-41f8-824c-d7b79b849b4c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:54.953638 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f8a8e3e1-df22-41f8-824c-d7b79b849b4c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:54.961653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8a8e3e1-df22-41f8-824c-d7b79b849b4c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:54.962183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8a8e3e1-df22-41f8-824c-d7b79b849b4c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:54.963498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8a8e3e1-df22-41f8-824c-d7b79b849b4c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:54.964031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f8a8e3e1-df22-41f8-824c-d7b79b849b4c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:55.109564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-12cac34a-8462-4097-94cd-7214d7dbb3d6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 28217 microversion: 2.20 time: 0.339131 Feb 17 03:32:55.110304 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 414/879] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:54 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 28217 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:55.181468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f8a8e3e1-df22-41f8-824c-d7b79b849b4c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:55.190427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f8a8e3e1-df22-41f8-824c-d7b79b849b4c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1363 microversion: 2.1 time: 0.242059 Feb 17 03:32:55.191020 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 466/880] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:54 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:55.254246 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-22616796-2d28-42e0-91ba-2104ee8e7748 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:55.255016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-22616796-2d28-42e0-91ba-2104ee8e7748 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:55.264215 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-22616796-2d28-42e0-91ba-2104ee8e7748 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:55.264726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-22616796-2d28-42e0-91ba-2104ee8e7748 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:55.265566 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-22616796-2d28-42e0-91ba-2104ee8e7748 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:55.266053 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-22616796-2d28-42e0-91ba-2104ee8e7748 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:55.491269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-22616796-2d28-42e0-91ba-2104ee8e7748 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:55.502199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-22616796-2d28-42e0-91ba-2104ee8e7748 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1274 microversion: 2.1 time: 0.252471 Feb 17 03:32:55.502796 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 415/881] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:55 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1274 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:56.127117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6c13db09-e194-45a5-b4e3-e2c54cdde94b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:56.128878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6c13db09-e194-45a5-b4e3-e2c54cdde94b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:56.144139 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c13db09-e194-45a5-b4e3-e2c54cdde94b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.145065 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c13db09-e194-45a5-b4e3-e2c54cdde94b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:56.146577 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c13db09-e194-45a5-b4e3-e2c54cdde94b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.147587 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c13db09-e194-45a5-b4e3-e2c54cdde94b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:56.210198 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4404fb29-0385-4025-986b-1f2fc3884f0e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:56.211164 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4404fb29-0385-4025-986b-1f2fc3884f0e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:56.240555 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4404fb29-0385-4025-986b-1f2fc3884f0e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.241288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4404fb29-0385-4025-986b-1f2fc3884f0e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:56.242382 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4404fb29-0385-4025-986b-1f2fc3884f0e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.243290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4404fb29-0385-4025-986b-1f2fc3884f0e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:56.367915 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6c13db09-e194-45a5-b4e3-e2c54cdde94b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 28508 microversion: 2.20 time: 0.249237 Feb 17 03:32:56.369354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 467/882] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:56 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 28508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:56.480796 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4404fb29-0385-4025-986b-1f2fc3884f0e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:56.489821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4404fb29-0385-4025-986b-1f2fc3884f0e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1548 microversion: 2.1 time: 0.283807 Feb 17 03:32:56.490416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 416/883] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:56 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1548 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:56.513818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9bedd060-6556-416c-abf3-57a25b6ba079 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:56.515077 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9bedd060-6556-416c-abf3-57a25b6ba079 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:56.520573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-83b7fe90-bb5a-45c8-acf7-051e73a9cfd1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:56.521229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-83b7fe90-bb5a-45c8-acf7-051e73a9cfd1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:56.528262 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bedd060-6556-416c-abf3-57a25b6ba079 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.528769 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bedd060-6556-416c-abf3-57a25b6ba079 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:56.529013 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83b7fe90-bb5a-45c8-acf7-051e73a9cfd1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.529509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83b7fe90-bb5a-45c8-acf7-051e73a9cfd1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:56.529642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bedd060-6556-416c-abf3-57a25b6ba079 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.530069 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bedd060-6556-416c-abf3-57a25b6ba079 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:56.530319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83b7fe90-bb5a-45c8-acf7-051e73a9cfd1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.530798 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83b7fe90-bb5a-45c8-acf7-051e73a9cfd1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:56.781874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9bedd060-6556-416c-abf3-57a25b6ba079 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.276364 Feb 17 03:32:56.782435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 468/884] 10.222.0.46 () {58 vars in 1265 bytes} [Wed Feb 17 03:32:56 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-interface => generated 284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:56.840453 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-83b7fe90-bb5a-45c8-acf7-051e73a9cfd1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:56.856251 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-83b7fe90-bb5a-45c8-acf7-051e73a9cfd1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1274 microversion: 2.1 time: 0.339089 Feb 17 03:32:56.857331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 417/885] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:56 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1274 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:57.380458 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7bd59571-2875-4717-893e-8d678cefac6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:57.381501 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7bd59571-2875-4717-893e-8d678cefac6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:57.390053 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bd59571-2875-4717-893e-8d678cefac6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:57.390547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bd59571-2875-4717-893e-8d678cefac6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:57.391368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bd59571-2875-4717-893e-8d678cefac6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:57.391879 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bd59571-2875-4717-893e-8d678cefac6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:57.552419 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7bd59571-2875-4717-893e-8d678cefac6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 28676 microversion: 2.20 time: 0.175630 Feb 17 03:32:57.553050 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 469/886] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:57 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 28676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:57.881567 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-054309df-b2b2-4163-9ab8-f91889c56c9e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:57.882237 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-054309df-b2b2-4163-9ab8-f91889c56c9e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:57.891965 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-054309df-b2b2-4163-9ab8-f91889c56c9e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:57.898000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-054309df-b2b2-4163-9ab8-f91889c56c9e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:57.899703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-054309df-b2b2-4163-9ab8-f91889c56c9e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:57.900620 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-054309df-b2b2-4163-9ab8-f91889c56c9e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:58.159433 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-054309df-b2b2-4163-9ab8-f91889c56c9e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:58.169076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-054309df-b2b2-4163-9ab8-f91889c56c9e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1274 microversion: 2.1 time: 0.291653 Feb 17 03:32:58.169666 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 418/887] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:57 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1274 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:58.565783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-df471515-240c-4f7c-adc2-038e1384072f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:58.567670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-df471515-240c-4f7c-adc2-038e1384072f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:58.577822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df471515-240c-4f7c-adc2-038e1384072f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:58.578631 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df471515-240c-4f7c-adc2-038e1384072f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:58.579588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df471515-240c-4f7c-adc2-038e1384072f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:58.580410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df471515-240c-4f7c-adc2-038e1384072f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:58.707998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-df471515-240c-4f7c-adc2-038e1384072f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 28676 microversion: 2.20 time: 0.146280 Feb 17 03:32:58.712985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 470/888] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:58 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 28676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:58.803677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-93fcf395-99b0-4304-8779-41b2b6dcd6ad tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:58.804814 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-93fcf395-99b0-4304-8779-41b2b6dcd6ad tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:58.812761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-d075eedb-ea81-453a-b3a6-95a4f33cf8d8 req-fdd4706d-9014-416c-a2ed-cb84bb3ef598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73390732-5d83-45e6-a650-228f06ea5210", "tag": "493bd038-841b-4470-a3d9-cbec3c0afcd9"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:58.813876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-93fcf395-99b0-4304-8779-41b2b6dcd6ad tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:58.814389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:58.814389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:32:58.814587 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-93fcf395-99b0-4304-8779-41b2b6dcd6ad tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:58.815221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-93fcf395-99b0-4304-8779-41b2b6dcd6ad tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:58.815746 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-93fcf395-99b0-4304-8779-41b2b6dcd6ad tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:58.824217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-d075eedb-ea81-453a-b3a6-95a4f33cf8d8 req-fdd4706d-9014-416c-a2ed-cb84bb3ef598 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:58.824713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-d075eedb-ea81-453a-b3a6-95a4f33cf8d8 req-fdd4706d-9014-416c-a2ed-cb84bb3ef598 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:58.842624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-d075eedb-ea81-453a-b3a6-95a4f33cf8d8 req-fdd4706d-9014-416c-a2ed-cb84bb3ef598 service nova] Creating event network-changed:493bd038-841b-4470-a3d9-cbec3c0afcd9 for instance 73390732-5d83-45e6-a650-228f06ea5210 on hv-cinder-75996 Feb 17 03:32:58.847564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-d075eedb-ea81-453a-b3a6-95a4f33cf8d8 req-fdd4706d-9014-416c-a2ed-cb84bb3ef598 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039166 Feb 17 03:32:58.849446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 471/889] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:58.947765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-93fcf395-99b0-4304-8779-41b2b6dcd6ad tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 14 microversion: 2.1 time: 0.147595 Feb 17 03:32:58.948619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 419/890] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:58 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:32:59.193719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6871deeb-fbd3-4444-9656-3f7e1236c619 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:59.194484 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6871deeb-fbd3-4444-9656-3f7e1236c619 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:59.203422 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6871deeb-fbd3-4444-9656-3f7e1236c619 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:59.204170 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6871deeb-fbd3-4444-9656-3f7e1236c619 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:59.204942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6871deeb-fbd3-4444-9656-3f7e1236c619 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:59.205643 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6871deeb-fbd3-4444-9656-3f7e1236c619 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:59.453374 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6871deeb-fbd3-4444-9656-3f7e1236c619 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:59.463165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6871deeb-fbd3-4444-9656-3f7e1236c619 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1274 microversion: 2.1 time: 0.273618 Feb 17 03:32:59.464144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 472/891] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:59 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1274 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:59.722319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fb1478d3-77e5-475f-b29e-7cd94a103b48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:59.723468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fb1478d3-77e5-475f-b29e-7cd94a103b48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:59.732873 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fb1478d3-77e5-475f-b29e-7cd94a103b48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:59.733383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fb1478d3-77e5-475f-b29e-7cd94a103b48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:59.734224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fb1478d3-77e5-475f-b29e-7cd94a103b48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:59.735348 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fb1478d3-77e5-475f-b29e-7cd94a103b48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:59.865285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fb1478d3-77e5-475f-b29e-7cd94a103b48 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 28676 microversion: 2.20 time: 0.147394 Feb 17 03:32:59.867296 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 420/892] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:59 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 28676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:59.960101 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f216917d-6aff-4c13-9a93-cce03eec2956 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:59.961165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f216917d-6aff-4c13-9a93-cce03eec2956 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:59.970727 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f216917d-6aff-4c13-9a93-cce03eec2956 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:59.971310 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f216917d-6aff-4c13-9a93-cce03eec2956 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:59.972058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f216917d-6aff-4c13-9a93-cce03eec2956 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:59.972535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f216917d-6aff-4c13-9a93-cce03eec2956 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:00.094967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f216917d-6aff-4c13-9a93-cce03eec2956 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 14 microversion: 2.1 time: 0.138668 Feb 17 03:33:00.095724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 473/893] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:59 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:33:00.483060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-afc2b113-7ce1-4226-adcd-0a1585329a67 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:00.483948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-afc2b113-7ce1-4226-adcd-0a1585329a67 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:00.492580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-afc2b113-7ce1-4226-adcd-0a1585329a67 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:00.493084 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-afc2b113-7ce1-4226-adcd-0a1585329a67 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:00.494117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-afc2b113-7ce1-4226-adcd-0a1585329a67 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:00.494611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-afc2b113-7ce1-4226-adcd-0a1585329a67 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:00.715037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-afc2b113-7ce1-4226-adcd-0a1585329a67 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:00.723792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-afc2b113-7ce1-4226-adcd-0a1585329a67 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1274 microversion: 2.1 time: 0.245962 Feb 17 03:33:00.724387 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 421/894] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:00 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:00.878431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cacbf210-65fa-414d-85d0-11b9c89b981c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:00.879590 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cacbf210-65fa-414d-85d0-11b9c89b981c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:00.888944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cacbf210-65fa-414d-85d0-11b9c89b981c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:00.889463 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cacbf210-65fa-414d-85d0-11b9c89b981c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:00.890271 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cacbf210-65fa-414d-85d0-11b9c89b981c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:00.890766 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cacbf210-65fa-414d-85d0-11b9c89b981c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:01.020721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cacbf210-65fa-414d-85d0-11b9c89b981c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 29614 microversion: 2.20 time: 0.146651 Feb 17 03:33:01.021407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 474/895] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:00 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 29614 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:33:01.107733 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-04e4e505-a658-4d8a-8316-6e84cd5e1e7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:01.108823 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-04e4e505-a658-4d8a-8316-6e84cd5e1e7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:01.116697 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-04e4e505-a658-4d8a-8316-6e84cd5e1e7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:01.117202 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-04e4e505-a658-4d8a-8316-6e84cd5e1e7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:01.118027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-04e4e505-a658-4d8a-8316-6e84cd5e1e7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:01.118520 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-04e4e505-a658-4d8a-8316-6e84cd5e1e7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:01.255383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-04e4e505-a658-4d8a-8316-6e84cd5e1e7e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 14 microversion: 2.1 time: 0.151450 Feb 17 03:33:01.256148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 422/896] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:01 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 03:33:01.747614 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-27b660a6-c0af-4855-97b1-7a6a0a88392c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:01.748872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-27b660a6-c0af-4855-97b1-7a6a0a88392c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:01.762460 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-27b660a6-c0af-4855-97b1-7a6a0a88392c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:01.763259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-27b660a6-c0af-4855-97b1-7a6a0a88392c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:01.764641 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-27b660a6-c0af-4855-97b1-7a6a0a88392c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:01.765405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-27b660a6-c0af-4855-97b1-7a6a0a88392c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:02.021897 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-27b660a6-c0af-4855-97b1-7a6a0a88392c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:02.032700 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-27b660a6-c0af-4855-97b1-7a6a0a88392c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1274 microversion: 2.1 time: 0.293242 Feb 17 03:33:02.033314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 475/897] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:01 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1274 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:33:02.033698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b07dc712-a75b-493b-862f-b6e410b622a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:02.034973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b07dc712-a75b-493b-862f-b6e410b622a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:02.044821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b07dc712-a75b-493b-862f-b6e410b622a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:02.045318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b07dc712-a75b-493b-862f-b6e410b622a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:02.046158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b07dc712-a75b-493b-862f-b6e410b622a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:02.046639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b07dc712-a75b-493b-862f-b6e410b622a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:02.191014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b07dc712-a75b-493b-862f-b6e410b622a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 31429 microversion: 2.20 time: 0.161569 Feb 17 03:33:02.191778 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 423/898] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:02 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 31429 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:33:02.267110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4f1f84b9-c584-4ba1-9453-a04df060055c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:02.268182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4f1f84b9-c584-4ba1-9453-a04df060055c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:02.276719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f1f84b9-c584-4ba1-9453-a04df060055c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:02.277168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f1f84b9-c584-4ba1-9453-a04df060055c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:02.277995 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f1f84b9-c584-4ba1-9453-a04df060055c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:02.278485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f1f84b9-c584-4ba1-9453-a04df060055c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:02.423295 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4f1f84b9-c584-4ba1-9453-a04df060055c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 14 microversion: 2.1 time: 0.160316 Feb 17 03:33:02.424051 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 476/899] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:02 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:33:03.056932 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9ba55d0f-b2f7-45a0-81d6-e93655858287 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:03.057706 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9ba55d0f-b2f7-45a0-81d6-e93655858287 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:03.066661 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ba55d0f-b2f7-45a0-81d6-e93655858287 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:03.067163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ba55d0f-b2f7-45a0-81d6-e93655858287 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:03.068034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ba55d0f-b2f7-45a0-81d6-e93655858287 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:03.068526 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ba55d0f-b2f7-45a0-81d6-e93655858287 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:03.207435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-025c8732-bd83-4f1c-8b7a-21991bdd8d6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:03.210577 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-025c8732-bd83-4f1c-8b7a-21991bdd8d6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:03.230600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-025c8732-bd83-4f1c-8b7a-21991bdd8d6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:03.231556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-025c8732-bd83-4f1c-8b7a-21991bdd8d6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:03.233079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-025c8732-bd83-4f1c-8b7a-21991bdd8d6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:03.234490 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-025c8732-bd83-4f1c-8b7a-21991bdd8d6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:03.306767 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9ba55d0f-b2f7-45a0-81d6-e93655858287 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:03.315936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9ba55d0f-b2f7-45a0-81d6-e93655858287 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1274 microversion: 2.1 time: 0.267334 Feb 17 03:33:03.316473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 424/900] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:03 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:03.401088 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-025c8732-bd83-4f1c-8b7a-21991bdd8d6f tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 32994 microversion: 2.20 time: 0.200746 Feb 17 03:33:03.401798 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 477/901] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:03 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 32994 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:33:03.434624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cc94c51b-725f-4da2-b076-aea1831a64c8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:03.435734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cc94c51b-725f-4da2-b076-aea1831a64c8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:03.443437 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc94c51b-725f-4da2-b076-aea1831a64c8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:03.443966 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc94c51b-725f-4da2-b076-aea1831a64c8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:03.444815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc94c51b-725f-4da2-b076-aea1831a64c8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:03.445297 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc94c51b-725f-4da2-b076-aea1831a64c8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:03.578985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cc94c51b-725f-4da2-b076-aea1831a64c8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 14 microversion: 2.1 time: 0.148143 Feb 17 03:33:03.579619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 425/902] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:03 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:33:04.335978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9af6f04b-f61f-49c9-918c-a8518d978316 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:04.336875 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9af6f04b-f61f-49c9-918c-a8518d978316 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:04.346039 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9af6f04b-f61f-49c9-918c-a8518d978316 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.346540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9af6f04b-f61f-49c9-918c-a8518d978316 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:04.347379 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9af6f04b-f61f-49c9-918c-a8518d978316 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.347897 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9af6f04b-f61f-49c9-918c-a8518d978316 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:04.418233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2b7287e9-ad2c-4b28-9c10-b59b8d80cb78 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:04.419670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2b7287e9-ad2c-4b28-9c10-b59b8d80cb78 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:04.428634 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2b7287e9-ad2c-4b28-9c10-b59b8d80cb78 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.429060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2b7287e9-ad2c-4b28-9c10-b59b8d80cb78 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:04.430096 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2b7287e9-ad2c-4b28-9c10-b59b8d80cb78 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.430586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2b7287e9-ad2c-4b28-9c10-b59b8d80cb78 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:04.566955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2b7287e9-ad2c-4b28-9c10-b59b8d80cb78 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 33820 microversion: 2.20 time: 0.153365 Feb 17 03:33:04.570925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 426/903] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:04 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 33820 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:33:04.585944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-2fa55a77-39c8-4e5c-b84c-8415fc589b4a req-d05d01cf-8fc2-4261-b2b8-0dee2b667f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09664edd-5f9f-4b5e-b7b1-06857eff4d59", "name": "network-vif-plugged", "status": "completed", "tag": "35520748-b121-42ff-b9ac-e966407e4668"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:04.586651 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:33:04.586651 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:33:04.605522 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-2fa55a77-39c8-4e5c-b84c-8415fc589b4a req-d05d01cf-8fc2-4261-b2b8-0dee2b667f87 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.606338 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-2fa55a77-39c8-4e5c-b84c-8415fc589b4a req-d05d01cf-8fc2-4261-b2b8-0dee2b667f87 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:04.644736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-2fa55a77-39c8-4e5c-b84c-8415fc589b4a req-d05d01cf-8fc2-4261-b2b8-0dee2b667f87 service nova] Creating event network-vif-plugged:35520748-b121-42ff-b9ac-e966407e4668 for instance 09664edd-5f9f-4b5e-b7b1-06857eff4d59 on hv-cinder-75996 Feb 17 03:33:04.653370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-2fa55a77-39c8-4e5c-b84c-8415fc589b4a req-d05d01cf-8fc2-4261-b2b8-0dee2b667f87 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079366 Feb 17 03:33:04.654298 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 427/904] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:33:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:04.660287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-97bca3ed-baa7-45df-b9c6-28cf72ce0fba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:04.661411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-97bca3ed-baa7-45df-b9c6-28cf72ce0fba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:04.670115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-97bca3ed-baa7-45df-b9c6-28cf72ce0fba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.670637 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-97bca3ed-baa7-45df-b9c6-28cf72ce0fba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:04.671478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-97bca3ed-baa7-45df-b9c6-28cf72ce0fba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.671994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-97bca3ed-baa7-45df-b9c6-28cf72ce0fba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:04.674199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9af6f04b-f61f-49c9-918c-a8518d978316 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:04.686902 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9af6f04b-f61f-49c9-918c-a8518d978316 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1274 microversion: 2.1 time: 0.355364 Feb 17 03:33:04.687900 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 478/905] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:04 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1274 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:04.802557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-97bca3ed-baa7-45df-b9c6-28cf72ce0fba tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 14 microversion: 2.1 time: 0.146616 Feb 17 03:33:04.803246 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 428/906] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:04 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:33:05.581807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fe1c6746-dfde-4df6-9039-2e2c5d6a53d5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:05.582863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fe1c6746-dfde-4df6-9039-2e2c5d6a53d5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:05.592526 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe1c6746-dfde-4df6-9039-2e2c5d6a53d5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:05.593032 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe1c6746-dfde-4df6-9039-2e2c5d6a53d5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:05.593873 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe1c6746-dfde-4df6-9039-2e2c5d6a53d5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:05.594354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe1c6746-dfde-4df6-9039-2e2c5d6a53d5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:05.705347 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-02faad4c-89df-41b2-884b-4fb7ee88c434 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:05.706146 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-02faad4c-89df-41b2-884b-4fb7ee88c434 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:05.715525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02faad4c-89df-41b2-884b-4fb7ee88c434 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:05.716029 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02faad4c-89df-41b2-884b-4fb7ee88c434 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:05.716860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02faad4c-89df-41b2-884b-4fb7ee88c434 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:05.717341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02faad4c-89df-41b2-884b-4fb7ee88c434 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:05.740509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fe1c6746-dfde-4df6-9039-2e2c5d6a53d5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 34874 microversion: 2.20 time: 0.162483 Feb 17 03:33:05.745582 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 479/907] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:05 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 34874 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:33:05.815437 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e87d21f7-affe-4ae4-ab1e-aa980501c29c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:05.816861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e87d21f7-affe-4ae4-ab1e-aa980501c29c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:05.825666 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e87d21f7-affe-4ae4-ab1e-aa980501c29c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:05.826288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e87d21f7-affe-4ae4-ab1e-aa980501c29c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:05.827245 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e87d21f7-affe-4ae4-ab1e-aa980501c29c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:05.827833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e87d21f7-affe-4ae4-ab1e-aa980501c29c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:05.942286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-02faad4c-89df-41b2-884b-4fb7ee88c434 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:05.951338 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-02faad4c-89df-41b2-884b-4fb7ee88c434 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1274 microversion: 2.1 time: 0.250424 Feb 17 03:33:05.951908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 429/908] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:05 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1274 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:33:05.959252 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e87d21f7-affe-4ae4-ab1e-aa980501c29c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 14 microversion: 2.1 time: 0.148075 Feb 17 03:33:05.961638 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 480/909] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:05 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 03:33:06.753883 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0ee6c060-c357-4869-ae4f-8bfa399f29c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:06.754899 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0ee6c060-c357-4869-ae4f-8bfa399f29c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:06.763774 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0ee6c060-c357-4869-ae4f-8bfa399f29c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:06.764271 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0ee6c060-c357-4869-ae4f-8bfa399f29c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:06.765085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0ee6c060-c357-4869-ae4f-8bfa399f29c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:06.765566 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0ee6c060-c357-4869-ae4f-8bfa399f29c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:06.908136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0ee6c060-c357-4869-ae4f-8bfa399f29c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 35679 microversion: 2.20 time: 0.157960 Feb 17 03:33:06.909191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 430/910] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:06 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 35679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:33:06.970521 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-023e9144-852f-4e4f-9297-30f47e8063a8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:06.971290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-023e9144-852f-4e4f-9297-30f47e8063a8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:06.972218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4ed546e1-3d50-4f5d-9efb-a94864cf7ad1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:06.973364 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4ed546e1-3d50-4f5d-9efb-a94864cf7ad1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:06.981111 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-023e9144-852f-4e4f-9297-30f47e8063a8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:06.981611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-023e9144-852f-4e4f-9297-30f47e8063a8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:06.982490 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-023e9144-852f-4e4f-9297-30f47e8063a8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:06.982982 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-023e9144-852f-4e4f-9297-30f47e8063a8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:06.992564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ed546e1-3d50-4f5d-9efb-a94864cf7ad1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:06.993109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ed546e1-3d50-4f5d-9efb-a94864cf7ad1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:06.996323 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ed546e1-3d50-4f5d-9efb-a94864cf7ad1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:06.996821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ed546e1-3d50-4f5d-9efb-a94864cf7ad1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:07.139494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4ed546e1-3d50-4f5d-9efb-a94864cf7ad1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 14 microversion: 2.1 time: 0.171684 Feb 17 03:33:07.140436 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 431/911] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:06 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:33:07.209079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-023e9144-852f-4e4f-9297-30f47e8063a8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:07.219686 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-023e9144-852f-4e4f-9297-30f47e8063a8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1461 microversion: 2.1 time: 0.253530 Feb 17 03:33:07.220308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 481/912] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:06 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1461 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:07.237809 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cd4d6ec2-973e-4d0a-aef5-e99da7bc136a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:07.238571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cd4d6ec2-973e-4d0a-aef5-e99da7bc136a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:07.247651 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cd4d6ec2-973e-4d0a-aef5-e99da7bc136a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:07.248162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cd4d6ec2-973e-4d0a-aef5-e99da7bc136a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:07.248992 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cd4d6ec2-973e-4d0a-aef5-e99da7bc136a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:07.249482 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cd4d6ec2-973e-4d0a-aef5-e99da7bc136a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:07.464906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cd4d6ec2-973e-4d0a-aef5-e99da7bc136a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:07.474190 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cd4d6ec2-973e-4d0a-aef5-e99da7bc136a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1461 microversion: 2.1 time: 0.240803 Feb 17 03:33:07.474790 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 432/913] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:07 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1461 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:07.492982 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4299d96a-d7ad-46bc-b1d8-84dc9e0dcc9e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'create', calling method: .version_select at 0x7f012e483598>, body: {"pool": null} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:07.921166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9f8e0c76-530e-44fe-a352-99a992e45d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:07.922131 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9f8e0c76-530e-44fe-a352-99a992e45d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:07.931361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f8e0c76-530e-44fe-a352-99a992e45d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:07.931934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f8e0c76-530e-44fe-a352-99a992e45d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:07.932783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f8e0c76-530e-44fe-a352-99a992e45d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:07.933263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f8e0c76-530e-44fe-a352-99a992e45d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:08.088569 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9f8e0c76-530e-44fe-a352-99a992e45d6c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 37018 microversion: 2.20 time: 0.171264 Feb 17 03:33:08.089384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 433/914] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:07 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 37018 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:33:08.153089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4e498ed8-60f4-400b-ab99-040f6d89342b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:08.154285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4e498ed8-60f4-400b-ab99-040f6d89342b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:08.163503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e498ed8-60f4-400b-ab99-040f6d89342b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:08.164044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e498ed8-60f4-400b-ab99-040f6d89342b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:08.164887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e498ed8-60f4-400b-ab99-040f6d89342b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:08.165367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e498ed8-60f4-400b-ab99-040f6d89342b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:08.323479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4e498ed8-60f4-400b-ab99-040f6d89342b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 14 microversion: 2.1 time: 0.174878 Feb 17 03:33:08.324215 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 434/915] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:08 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:33:09.102586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-24cd37ad-f962-40c4-b206-0b89e0a840a8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:09.104074 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-24cd37ad-f962-40c4-b206-0b89e0a840a8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:09.112410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-24cd37ad-f962-40c4-b206-0b89e0a840a8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:09.112848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-24cd37ad-f962-40c4-b206-0b89e0a840a8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:09.113672 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-24cd37ad-f962-40c4-b206-0b89e0a840a8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:09.114153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-24cd37ad-f962-40c4-b206-0b89e0a840a8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:09.259985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-24cd37ad-f962-40c4-b206-0b89e0a840a8 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 38225 microversion: 2.20 time: 0.161340 Feb 17 03:33:09.264550 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 435/916] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:09 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 38225 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:33:09.335905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-641d6f4a-c05f-4597-9973-14e438055f61 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:09.338342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-641d6f4a-c05f-4597-9973-14e438055f61 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:09.346865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-641d6f4a-c05f-4597-9973-14e438055f61 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:09.347376 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-641d6f4a-c05f-4597-9973-14e438055f61 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:09.348237 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-641d6f4a-c05f-4597-9973-14e438055f61 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:09.348721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-641d6f4a-c05f-4597-9973-14e438055f61 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:09.479198 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-641d6f4a-c05f-4597-9973-14e438055f61 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 14 microversion: 2.1 time: 0.147632 Feb 17 03:33:09.479959 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 436/917] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:09 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 03:33:09.749678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4299d96a-d7ad-46bc-b1d8-84dc9e0dcc9e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.260651 Feb 17 03:33:09.750335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 482/918] 10.222.0.46 () {60 vars in 1160 bytes} [Wed Feb 17 03:33:07 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:09.763322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fa5e001d-1731-4ad9-b773-09b6f04ca0a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.140"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:09.764680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fa5e001d-1731-4ad9-b773-09b6f04ca0a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:09.773166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fa5e001d-1731-4ad9-b773-09b6f04ca0a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:09.773671 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fa5e001d-1731-4ad9-b773-09b6f04ca0a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:09.774500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fa5e001d-1731-4ad9-b773-09b6f04ca0a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:09.774991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fa5e001d-1731-4ad9-b773-09b6f04ca0a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:09.841079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fa5e001d-1731-4ad9-b773-09b6f04ca0a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Acquired lock "refresh_cache-09664edd-5f9f-4b5e-b7b1-06857eff4d59" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:33:10.273600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fef671db-e68d-476f-b8f1-5edaca085e11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:10.275187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fef671db-e68d-476f-b8f1-5edaca085e11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:10.284172 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fef671db-e68d-476f-b8f1-5edaca085e11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:10.284679 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fef671db-e68d-476f-b8f1-5edaca085e11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:10.285525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fef671db-e68d-476f-b8f1-5edaca085e11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:10.286018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fef671db-e68d-476f-b8f1-5edaca085e11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:10.561207 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fef671db-e68d-476f-b8f1-5edaca085e11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 38225 microversion: 2.20 time: 0.291806 Feb 17 03:33:10.565525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 483/919] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:10 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 38225 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:33:10.567339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-91cc74bc-9b69-446a-af43-3936396c9a99 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:10.568509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-91cc74bc-9b69-446a-af43-3936396c9a99 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:10.577592 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91cc74bc-9b69-446a-af43-3936396c9a99 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:10.578106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91cc74bc-9b69-446a-af43-3936396c9a99 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:10.578937 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91cc74bc-9b69-446a-af43-3936396c9a99 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:10.579429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91cc74bc-9b69-446a-af43-3936396c9a99 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:10.717168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-91cc74bc-9b69-446a-af43-3936396c9a99 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 12758 microversion: 2.1 time: 0.153751 Feb 17 03:33:10.717880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 484/920] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:10 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 12758 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:11.574756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-02eab2b2-d873-453a-a657-79207f864732 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:11.575878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-02eab2b2-d873-453a-a657-79207f864732 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:11.584975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02eab2b2-d873-453a-a657-79207f864732 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:11.585476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02eab2b2-d873-453a-a657-79207f864732 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:11.586359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02eab2b2-d873-453a-a657-79207f864732 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:11.586847 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02eab2b2-d873-453a-a657-79207f864732 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:11.716561 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-02eab2b2-d873-453a-a657-79207f864732 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 38225 microversion: 2.20 time: 0.146230 Feb 17 03:33:11.717573 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 485/921] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:11 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 38225 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:33:11.732432 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d75379a4-7a50-48a5-b282-759a3434aa0f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:11.733998 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d75379a4-7a50-48a5-b282-759a3434aa0f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:11.746144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d75379a4-7a50-48a5-b282-759a3434aa0f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:11.746644 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d75379a4-7a50-48a5-b282-759a3434aa0f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:11.748070 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d75379a4-7a50-48a5-b282-759a3434aa0f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:11.748737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d75379a4-7a50-48a5-b282-759a3434aa0f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:11.890543 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-fa5e001d-1731-4ad9-b773-09b6f04ca0a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Building network info cache for instance {{(pid=98184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:33:11.897641 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d75379a4-7a50-48a5-b282-759a3434aa0f tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 18561 microversion: 2.1 time: 0.171538 Feb 17 03:33:11.898356 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 486/922] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:11 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 18561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:33:11.905140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-c3ec8e2a-ed7a-4254-ba2d-7bc5d01b9ea7 req-8304bc9a-ca0f-45ca-90d4-772da14081fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09664edd-5f9f-4b5e-b7b1-06857eff4d59", "tag": "35520748-b121-42ff-b9ac-e966407e4668"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:11.906890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:33:11.906890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:33:11.917464 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-c3ec8e2a-ed7a-4254-ba2d-7bc5d01b9ea7 req-8304bc9a-ca0f-45ca-90d4-772da14081fd service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:11.918049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-c3ec8e2a-ed7a-4254-ba2d-7bc5d01b9ea7 req-8304bc9a-ca0f-45ca-90d4-772da14081fd service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:11.936993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-c3ec8e2a-ed7a-4254-ba2d-7bc5d01b9ea7 req-8304bc9a-ca0f-45ca-90d4-772da14081fd service nova] Creating event network-changed:35520748-b121-42ff-b9ac-e966407e4668 for instance 09664edd-5f9f-4b5e-b7b1-06857eff4d59 on hv-cinder-75996 Feb 17 03:33:11.942922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-c3ec8e2a-ed7a-4254-ba2d-7bc5d01b9ea7 req-8304bc9a-ca0f-45ca-90d4-772da14081fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042529 Feb 17 03:33:11.944150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 487/923] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:33:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:12.733758 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e324e81e-063b-4e06-82b8-6b7b4e40bcde tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:12.735495 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e324e81e-063b-4e06-82b8-6b7b4e40bcde tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:12.744162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e324e81e-063b-4e06-82b8-6b7b4e40bcde tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:12.744863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e324e81e-063b-4e06-82b8-6b7b4e40bcde tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:12.745878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e324e81e-063b-4e06-82b8-6b7b4e40bcde tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:12.746518 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e324e81e-063b-4e06-82b8-6b7b4e40bcde tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:12.753289 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-fa5e001d-1731-4ad9-b773-09b6f04ca0a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Updating instance_info_cache with network_info: [{"id": "35520748-b121-42ff-b9ac-e966407e4668", "address": "fa:16:3e:63:16:2b", "network": {"id": "4e746511-e0b4-40cf-9f26-4fcf068fda47", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-563910191-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fce55aed27e14d6791193d35e5ac2137", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap35520748-b1", "ovs_interfaceid": "35520748-b121-42ff-b9ac-e966407e4668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:33:12.765853 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fa5e001d-1731-4ad9-b773-09b6f04ca0a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Releasing lock "refresh_cache-09664edd-5f9f-4b5e-b7b1-06857eff4d59" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:33:12.766774 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fa5e001d-1731-4ad9-b773-09b6f04ca0a5 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59/action" status: 202 len: 0 microversion: 2.1 time: 3.008750 Feb 17 03:33:12.768077 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 437/924] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:09 2021] POST /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59/action => generated 0 bytes in 3011 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 03:33:12.890265 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e324e81e-063b-4e06-82b8-6b7b4e40bcde tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 200 len: 38368 microversion: 2.20 time: 0.160702 Feb 17 03:33:12.896255 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 488/925] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:12 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 38368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:33:12.905730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2fbd873b-b6fa-4026-a317-67e393935243 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:12.906551 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2fbd873b-b6fa-4026-a317-67e393935243 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:12.911454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ec7a7847-07ea-4f5e-a3df-16b0aafe3ba8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:12.912135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ec7a7847-07ea-4f5e-a3df-16b0aafe3ba8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:12.917448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2fbd873b-b6fa-4026-a317-67e393935243 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:12.918213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2fbd873b-b6fa-4026-a317-67e393935243 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:12.919142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2fbd873b-b6fa-4026-a317-67e393935243 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:12.919800 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2fbd873b-b6fa-4026-a317-67e393935243 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:12.920492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ec7a7847-07ea-4f5e-a3df-16b0aafe3ba8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:12.921001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ec7a7847-07ea-4f5e-a3df-16b0aafe3ba8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:12.921829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ec7a7847-07ea-4f5e-a3df-16b0aafe3ba8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:12.922312 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ec7a7847-07ea-4f5e-a3df-16b0aafe3ba8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:12.982889 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2fbd873b-b6fa-4026-a317-67e393935243 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/ips" status: 200 len: 151 microversion: 2.20 time: 0.085148 Feb 17 03:33:12.983835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 438/926] 10.222.0.46 () {60 vars in 1279 bytes} [Wed Feb 17 03:33:12 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/ips => generated 151 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:13.068068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ec7a7847-07ea-4f5e-a3df-16b0aafe3ba8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 19342 microversion: 2.1 time: 0.161074 Feb 17 03:33:13.069289 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 489/927] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:12 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 19342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:14.081645 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-060f15c7-894d-4de7-b305-a407d5290dea tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:14.083445 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-060f15c7-894d-4de7-b305-a407d5290dea tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:14.090367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-060f15c7-894d-4de7-b305-a407d5290dea tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:14.090889 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-060f15c7-894d-4de7-b305-a407d5290dea tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:14.091736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-060f15c7-894d-4de7-b305-a407d5290dea tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:14.092226 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-060f15c7-894d-4de7-b305-a407d5290dea tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:14.229310 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-060f15c7-894d-4de7-b305-a407d5290dea tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 21966 microversion: 2.1 time: 0.152061 Feb 17 03:33:14.233410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 439/928] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:14 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 21966 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:15.243630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-89be217f-c9a1-44ba-9c40-bad9c30bca6b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:15.245525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-89be217f-c9a1-44ba-9c40-bad9c30bca6b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:15.254838 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89be217f-c9a1-44ba-9c40-bad9c30bca6b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:15.255373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89be217f-c9a1-44ba-9c40-bad9c30bca6b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:15.256317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89be217f-c9a1-44ba-9c40-bad9c30bca6b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:15.256843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89be217f-c9a1-44ba-9c40-bad9c30bca6b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:15.295120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d36a8f91-8e5d-4f58-8a08-da88721457c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:15.295827 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d36a8f91-8e5d-4f58-8a08-da88721457c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:15.304313 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d36a8f91-8e5d-4f58-8a08-da88721457c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:15.304820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d36a8f91-8e5d-4f58-8a08-da88721457c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:15.305653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d36a8f91-8e5d-4f58-8a08-da88721457c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:15.306140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d36a8f91-8e5d-4f58-8a08-da88721457c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:15.371376 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-d36a8f91-8e5d-4f58-8a08-da88721457c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lazy-loading 'flavor' on Instance uuid 4f420e97-ea65-416f-bcb1-3912244b4f06 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:33:15.393848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-89be217f-c9a1-44ba-9c40-bad9c30bca6b tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 23436 microversion: 2.1 time: 0.155377 Feb 17 03:33:15.394569 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 490/929] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:15 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 23436 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:15.873114 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d36a8f91-8e5d-4f58-8a08-da88721457c7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 202 len: 0 microversion: 2.20 time: 0.582371 Feb 17 03:33:15.873823 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 440/930] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:15 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:33:15.883332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d42b2c5f-763a-4a78-8b2c-816bbe34fcd5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:15.884958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d42b2c5f-763a-4a78-8b2c-816bbe34fcd5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:15.894125 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d42b2c5f-763a-4a78-8b2c-816bbe34fcd5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:15.894786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d42b2c5f-763a-4a78-8b2c-816bbe34fcd5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:15.895646 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d42b2c5f-763a-4a78-8b2c-816bbe34fcd5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:15.896135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d42b2c5f-763a-4a78-8b2c-816bbe34fcd5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:16.107685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d42b2c5f-763a-4a78-8b2c-816bbe34fcd5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:16.116850 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d42b2c5f-763a-4a78-8b2c-816bbe34fcd5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:16.118374 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d42b2c5f-763a-4a78-8b2c-816bbe34fcd5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:16.119565 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d42b2c5f-763a-4a78-8b2c-816bbe34fcd5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1724 microversion: 2.20 time: 0.240873 Feb 17 03:33:16.120151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 491/931] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:15 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:16.408617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-911e8127-7fd8-429c-ad3d-e694f8b913ee tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:16.409723 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-911e8127-7fd8-429c-ad3d-e694f8b913ee tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:16.418544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-911e8127-7fd8-429c-ad3d-e694f8b913ee tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:16.419041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-911e8127-7fd8-429c-ad3d-e694f8b913ee tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:16.419884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-911e8127-7fd8-429c-ad3d-e694f8b913ee tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:16.420367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-911e8127-7fd8-429c-ad3d-e694f8b913ee tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:16.563824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-911e8127-7fd8-429c-ad3d-e694f8b913ee tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 24989 microversion: 2.1 time: 0.159997 Feb 17 03:33:16.564414 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 441/932] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:16 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 24989 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:17.139467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1bb6a4ee-9059-4e75-ad0a-f43da6888775 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:17.140158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1bb6a4ee-9059-4e75-ad0a-f43da6888775 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:17.149123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bb6a4ee-9059-4e75-ad0a-f43da6888775 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:17.149632 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bb6a4ee-9059-4e75-ad0a-f43da6888775 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:17.150496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bb6a4ee-9059-4e75-ad0a-f43da6888775 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:17.150985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bb6a4ee-9059-4e75-ad0a-f43da6888775 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:17.364872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1bb6a4ee-9059-4e75-ad0a-f43da6888775 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:17.375220 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1bb6a4ee-9059-4e75-ad0a-f43da6888775 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:17.376810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1bb6a4ee-9059-4e75-ad0a-f43da6888775 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:17.378010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1bb6a4ee-9059-4e75-ad0a-f43da6888775 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1724 microversion: 2.20 time: 0.242642 Feb 17 03:33:17.378869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 492/933] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:17 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:17.577355 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-02856d3b-17f6-40ce-a908-4cddff528d75 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:17.578489 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-02856d3b-17f6-40ce-a908-4cddff528d75 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:17.587059 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02856d3b-17f6-40ce-a908-4cddff528d75 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:17.588095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02856d3b-17f6-40ce-a908-4cddff528d75 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:17.588900 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02856d3b-17f6-40ce-a908-4cddff528d75 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:17.589377 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02856d3b-17f6-40ce-a908-4cddff528d75 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:17.721976 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-02856d3b-17f6-40ce-a908-4cddff528d75 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 26186 microversion: 2.1 time: 0.148929 Feb 17 03:33:17.723362 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 442/934] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:17 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 26186 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:18.397917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-68ca9909-3f2e-4139-bcb0-1df1b494a96d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:18.398627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-68ca9909-3f2e-4139-bcb0-1df1b494a96d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:18.406744 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-68ca9909-3f2e-4139-bcb0-1df1b494a96d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:18.407245 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-68ca9909-3f2e-4139-bcb0-1df1b494a96d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:18.408119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-68ca9909-3f2e-4139-bcb0-1df1b494a96d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:18.408610 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-68ca9909-3f2e-4139-bcb0-1df1b494a96d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:18.633332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-68ca9909-3f2e-4139-bcb0-1df1b494a96d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:18.643267 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-68ca9909-3f2e-4139-bcb0-1df1b494a96d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:18.644859 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-68ca9909-3f2e-4139-bcb0-1df1b494a96d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:18.646063 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-68ca9909-3f2e-4139-bcb0-1df1b494a96d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1724 microversion: 2.20 time: 0.252243 Feb 17 03:33:18.646659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 493/935] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:18 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:18.736384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c29c730e-a2cb-4960-a3d9-4611f0242d36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:18.737473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c29c730e-a2cb-4960-a3d9-4611f0242d36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:18.746692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c29c730e-a2cb-4960-a3d9-4611f0242d36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:18.747184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c29c730e-a2cb-4960-a3d9-4611f0242d36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:18.748035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c29c730e-a2cb-4960-a3d9-4611f0242d36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:18.748525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c29c730e-a2cb-4960-a3d9-4611f0242d36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:18.902429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c29c730e-a2cb-4960-a3d9-4611f0242d36 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 27105 microversion: 2.1 time: 0.170471 Feb 17 03:33:18.903145 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 443/936] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:18 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 27105 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:19.666433 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-37efb3f5-592b-4d5b-ab02-0ae16539d9a9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:19.667099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-37efb3f5-592b-4d5b-ab02-0ae16539d9a9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:19.675496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-37efb3f5-592b-4d5b-ab02-0ae16539d9a9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:19.676017 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-37efb3f5-592b-4d5b-ab02-0ae16539d9a9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:19.676853 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-37efb3f5-592b-4d5b-ab02-0ae16539d9a9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:19.677342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-37efb3f5-592b-4d5b-ab02-0ae16539d9a9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:19.906363 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-37efb3f5-592b-4d5b-ab02-0ae16539d9a9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:19.916807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-37efb3f5-592b-4d5b-ab02-0ae16539d9a9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:19.917814 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3fffffd9-3ffd-4a5c-bacc-7cd417f37003 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:19.918301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-37efb3f5-592b-4d5b-ab02-0ae16539d9a9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:19.919393 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3fffffd9-3ffd-4a5c-bacc-7cd417f37003 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:19.919534 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-37efb3f5-592b-4d5b-ab02-0ae16539d9a9 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1724 microversion: 2.20 time: 0.257804 Feb 17 03:33:19.920197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 494/937] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:19 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:19.930810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3fffffd9-3ffd-4a5c-bacc-7cd417f37003 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:19.931452 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3fffffd9-3ffd-4a5c-bacc-7cd417f37003 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:19.932533 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3fffffd9-3ffd-4a5c-bacc-7cd417f37003 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:19.933170 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3fffffd9-3ffd-4a5c-bacc-7cd417f37003 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:20.096649 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3fffffd9-3ffd-4a5c-bacc-7cd417f37003 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 27566 microversion: 2.1 time: 0.185239 Feb 17 03:33:20.097600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 444/938] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:19 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 27566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:20.939443 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0c80b2eb-ca06-46d7-ac97-31e38cfbaea5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:20.940129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0c80b2eb-ca06-46d7-ac97-31e38cfbaea5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:20.948509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c80b2eb-ca06-46d7-ac97-31e38cfbaea5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:20.949005 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c80b2eb-ca06-46d7-ac97-31e38cfbaea5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:20.949818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c80b2eb-ca06-46d7-ac97-31e38cfbaea5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:20.950299 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0c80b2eb-ca06-46d7-ac97-31e38cfbaea5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:21.109031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4e457144-fb93-42bf-a67b-c8b7b1fa39a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:21.110369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4e457144-fb93-42bf-a67b-c8b7b1fa39a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:21.119354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e457144-fb93-42bf-a67b-c8b7b1fa39a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:21.120017 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e457144-fb93-42bf-a67b-c8b7b1fa39a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:21.120833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e457144-fb93-42bf-a67b-c8b7b1fa39a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:21.121339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4e457144-fb93-42bf-a67b-c8b7b1fa39a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:21.162163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0c80b2eb-ca06-46d7-ac97-31e38cfbaea5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:21.171627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0c80b2eb-ca06-46d7-ac97-31e38cfbaea5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:21.173187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0c80b2eb-ca06-46d7-ac97-31e38cfbaea5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:21.174361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0c80b2eb-ca06-46d7-ac97-31e38cfbaea5 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1724 microversion: 2.20 time: 0.239130 Feb 17 03:33:21.174945 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 495/939] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:20 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:21.257322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4e457144-fb93-42bf-a67b-c8b7b1fa39a8 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 27990 microversion: 2.1 time: 0.152561 Feb 17 03:33:21.258265 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 445/940] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:21 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 27990 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:22.193787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b92ae31b-d5c4-4142-b8e1-eacef1cb9600 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:22.194448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b92ae31b-d5c4-4142-b8e1-eacef1cb9600 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:22.203016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b92ae31b-d5c4-4142-b8e1-eacef1cb9600 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:22.203551 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b92ae31b-d5c4-4142-b8e1-eacef1cb9600 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:22.204409 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b92ae31b-d5c4-4142-b8e1-eacef1cb9600 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:22.204901 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b92ae31b-d5c4-4142-b8e1-eacef1cb9600 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:22.270951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1f56e1db-ed68-43c5-bd82-c128be395768 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:22.272260 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1f56e1db-ed68-43c5-bd82-c128be395768 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:22.280868 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f56e1db-ed68-43c5-bd82-c128be395768 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:22.281460 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f56e1db-ed68-43c5-bd82-c128be395768 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:22.282324 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f56e1db-ed68-43c5-bd82-c128be395768 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:22.282810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f56e1db-ed68-43c5-bd82-c128be395768 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:22.418394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b92ae31b-d5c4-4142-b8e1-eacef1cb9600 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:22.427745 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b92ae31b-d5c4-4142-b8e1-eacef1cb9600 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:22.429301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b92ae31b-d5c4-4142-b8e1-eacef1cb9600 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:22.430476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b92ae31b-d5c4-4142-b8e1-eacef1cb9600 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1724 microversion: 2.20 time: 0.240827 Feb 17 03:33:22.431059 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 496/941] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:22 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:22.443954 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1f56e1db-ed68-43c5-bd82-c128be395768 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 28173 microversion: 2.1 time: 0.177159 Feb 17 03:33:22.444658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 446/942] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:22 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 28173 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:33:23.452673 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-45790faf-e9b4-49ee-b421-96c53abe87b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:23.453326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-45790faf-e9b4-49ee-b421-96c53abe87b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:23.456864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a5bf7392-76a7-487a-8fa2-104f4566a40c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:23.458062 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a5bf7392-76a7-487a-8fa2-104f4566a40c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:23.461343 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45790faf-e9b4-49ee-b421-96c53abe87b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:23.461843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45790faf-e9b4-49ee-b421-96c53abe87b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:23.462676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45790faf-e9b4-49ee-b421-96c53abe87b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:23.463161 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-45790faf-e9b4-49ee-b421-96c53abe87b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:23.466603 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a5bf7392-76a7-487a-8fa2-104f4566a40c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:23.467115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a5bf7392-76a7-487a-8fa2-104f4566a40c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:23.467975 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a5bf7392-76a7-487a-8fa2-104f4566a40c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:23.468477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a5bf7392-76a7-487a-8fa2-104f4566a40c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:23.614023 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a5bf7392-76a7-487a-8fa2-104f4566a40c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 28464 microversion: 2.1 time: 0.161373 Feb 17 03:33:23.618122 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 447/943] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:23 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 28464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:33:23.676940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-45790faf-e9b4-49ee-b421-96c53abe87b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:23.686325 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-45790faf-e9b4-49ee-b421-96c53abe87b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:23.687919 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-45790faf-e9b4-49ee-b421-96c53abe87b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:23.689106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-45790faf-e9b4-49ee-b421-96c53abe87b6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1724 microversion: 2.20 time: 0.240432 Feb 17 03:33:23.689689 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 497/944] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:23 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:24.626300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4ec1c7fa-7f74-45f8-9643-4ecf0bc77950 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:24.627435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4ec1c7fa-7f74-45f8-9643-4ecf0bc77950 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:24.636461 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ec1c7fa-7f74-45f8-9643-4ecf0bc77950 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:24.636965 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ec1c7fa-7f74-45f8-9643-4ecf0bc77950 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:24.637796 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ec1c7fa-7f74-45f8-9643-4ecf0bc77950 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:24.638283 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ec1c7fa-7f74-45f8-9643-4ecf0bc77950 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:24.708694 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-304ef463-90e7-44b7-9435-c1d3d4915d6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:24.709358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-304ef463-90e7-44b7-9435-c1d3d4915d6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:24.717712 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-304ef463-90e7-44b7-9435-c1d3d4915d6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:24.718213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-304ef463-90e7-44b7-9435-c1d3d4915d6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:24.719037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-304ef463-90e7-44b7-9435-c1d3d4915d6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:24.719548 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-304ef463-90e7-44b7-9435-c1d3d4915d6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:24.778313 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4ec1c7fa-7f74-45f8-9643-4ecf0bc77950 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 28632 microversion: 2.1 time: 0.156306 Feb 17 03:33:24.782496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 448/945] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:24 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 28632 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:24.930003 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-304ef463-90e7-44b7-9435-c1d3d4915d6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:24.939762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-304ef463-90e7-44b7-9435-c1d3d4915d6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:24.941303 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-304ef463-90e7-44b7-9435-c1d3d4915d6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:24.942462 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-304ef463-90e7-44b7-9435-c1d3d4915d6d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1724 microversion: 2.20 time: 0.237766 Feb 17 03:33:24.943035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 498/946] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:24 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:33:25.791589 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a4d42fc0-e5fb-433b-8e88-76db89f23925 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:25.793339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a4d42fc0-e5fb-433b-8e88-76db89f23925 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:25.801852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a4d42fc0-e5fb-433b-8e88-76db89f23925 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:25.802361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a4d42fc0-e5fb-433b-8e88-76db89f23925 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:25.803186 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a4d42fc0-e5fb-433b-8e88-76db89f23925 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:25.803706 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a4d42fc0-e5fb-433b-8e88-76db89f23925 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:25.939040 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a4d42fc0-e5fb-433b-8e88-76db89f23925 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 28632 microversion: 2.1 time: 0.151937 Feb 17 03:33:25.939740 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 449/947] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:25 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 28632 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:25.962259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c11bca61-4090-4310-96d2-2f6c3d1cb256 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:25.962912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c11bca61-4090-4310-96d2-2f6c3d1cb256 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:25.971253 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c11bca61-4090-4310-96d2-2f6c3d1cb256 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:25.971780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c11bca61-4090-4310-96d2-2f6c3d1cb256 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:25.972589 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c11bca61-4090-4310-96d2-2f6c3d1cb256 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:25.973061 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c11bca61-4090-4310-96d2-2f6c3d1cb256 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:26.184473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c11bca61-4090-4310-96d2-2f6c3d1cb256 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:26.193741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c11bca61-4090-4310-96d2-2f6c3d1cb256 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:26.195284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c11bca61-4090-4310-96d2-2f6c3d1cb256 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:26.196467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c11bca61-4090-4310-96d2-2f6c3d1cb256 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1724 microversion: 2.20 time: 0.238148 Feb 17 03:33:26.197038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 499/948] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:25 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:26.952476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4d3b9b6e-f442-4e85-8deb-82dcf498286e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:26.953599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4d3b9b6e-f442-4e85-8deb-82dcf498286e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:26.962096 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d3b9b6e-f442-4e85-8deb-82dcf498286e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:26.962591 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d3b9b6e-f442-4e85-8deb-82dcf498286e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:26.963401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d3b9b6e-f442-4e85-8deb-82dcf498286e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:26.963911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4d3b9b6e-f442-4e85-8deb-82dcf498286e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:27.094514 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4d3b9b6e-f442-4e85-8deb-82dcf498286e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 28632 microversion: 2.1 time: 0.146719 Feb 17 03:33:27.095200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 450/949] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:26 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 28632 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:27.216900 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-40af2ba4-36a1-4993-a296-9f42599fcbb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:27.217658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-40af2ba4-36a1-4993-a296-9f42599fcbb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:27.225602 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40af2ba4-36a1-4993-a296-9f42599fcbb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:27.226372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40af2ba4-36a1-4993-a296-9f42599fcbb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:27.227192 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40af2ba4-36a1-4993-a296-9f42599fcbb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:27.227815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-40af2ba4-36a1-4993-a296-9f42599fcbb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:27.439165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-40af2ba4-36a1-4993-a296-9f42599fcbb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:27.448914 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-40af2ba4-36a1-4993-a296-9f42599fcbb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:27.450467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-40af2ba4-36a1-4993-a296-9f42599fcbb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:27.451651 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-40af2ba4-36a1-4993-a296-9f42599fcbb3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1745 microversion: 2.20 time: 0.239247 Feb 17 03:33:27.452224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 500/950] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:27 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1745 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:28.108070 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0cda27ab-ec5c-409c-910a-065be84f6742 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:28.109330 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0cda27ab-ec5c-409c-910a-065be84f6742 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:28.117808 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0cda27ab-ec5c-409c-910a-065be84f6742 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:28.118315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0cda27ab-ec5c-409c-910a-065be84f6742 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:28.119149 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0cda27ab-ec5c-409c-910a-065be84f6742 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:28.119663 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0cda27ab-ec5c-409c-910a-065be84f6742 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:28.272756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0cda27ab-ec5c-409c-910a-065be84f6742 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 28632 microversion: 2.1 time: 0.169202 Feb 17 03:33:28.273483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 451/951] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:28 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 28632 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:28.471378 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c23bdee4-d3e3-40df-8956-4e482f44ae33 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:28.472069 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c23bdee4-d3e3-40df-8956-4e482f44ae33 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:28.480711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c23bdee4-d3e3-40df-8956-4e482f44ae33 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:28.481211 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c23bdee4-d3e3-40df-8956-4e482f44ae33 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:28.482030 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c23bdee4-d3e3-40df-8956-4e482f44ae33 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:28.482511 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c23bdee4-d3e3-40df-8956-4e482f44ae33 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:28.696751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c23bdee4-d3e3-40df-8956-4e482f44ae33 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:28.706066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c23bdee4-d3e3-40df-8956-4e482f44ae33 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:28.707644 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c23bdee4-d3e3-40df-8956-4e482f44ae33 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:28.708814 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c23bdee4-d3e3-40df-8956-4e482f44ae33 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1745 microversion: 2.20 time: 0.241548 Feb 17 03:33:28.709726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 501/952] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:28 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1745 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:29.285725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-08bed0cf-9d6b-40f5-80ed-d3533b3fcb4e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:29.287028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-08bed0cf-9d6b-40f5-80ed-d3533b3fcb4e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:29.295630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-08bed0cf-9d6b-40f5-80ed-d3533b3fcb4e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:29.296140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-08bed0cf-9d6b-40f5-80ed-d3533b3fcb4e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:29.297013 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-08bed0cf-9d6b-40f5-80ed-d3533b3fcb4e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:29.297499 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-08bed0cf-9d6b-40f5-80ed-d3533b3fcb4e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:29.438226 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-08bed0cf-9d6b-40f5-80ed-d3533b3fcb4e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 28632 microversion: 2.1 time: 0.156745 Feb 17 03:33:29.439138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 452/953] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:29 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 28632 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:29.729284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d0a72e34-9821-40a5-8e6e-320f9b472a67 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:29.730801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d0a72e34-9821-40a5-8e6e-320f9b472a67 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:29.740190 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0a72e34-9821-40a5-8e6e-320f9b472a67 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:29.740656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0a72e34-9821-40a5-8e6e-320f9b472a67 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:29.741486 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0a72e34-9821-40a5-8e6e-320f9b472a67 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:29.741967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d0a72e34-9821-40a5-8e6e-320f9b472a67 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:29.977399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d0a72e34-9821-40a5-8e6e-320f9b472a67 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:29.988470 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d0a72e34-9821-40a5-8e6e-320f9b472a67 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:29.990049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d0a72e34-9821-40a5-8e6e-320f9b472a67 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:29.991270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d0a72e34-9821-40a5-8e6e-320f9b472a67 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1740 microversion: 2.20 time: 0.266298 Feb 17 03:33:29.992043 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 502/954] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:29 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:30.452584 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a2c63dad-8c16-4a9e-adef-4b2bcfecfabf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:30.454005 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a2c63dad-8c16-4a9e-adef-4b2bcfecfabf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:30.462537 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2c63dad-8c16-4a9e-adef-4b2bcfecfabf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:30.463037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2c63dad-8c16-4a9e-adef-4b2bcfecfabf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:30.463933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2c63dad-8c16-4a9e-adef-4b2bcfecfabf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:30.464660 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2c63dad-8c16-4a9e-adef-4b2bcfecfabf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:30.621226 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a2c63dad-8c16-4a9e-adef-4b2bcfecfabf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 30352 microversion: 2.1 time: 0.173379 Feb 17 03:33:30.622562 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 453/955] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:30 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 30352 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:31.013383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-dee5f81b-77b9-4a49-9c02-163bfaafc54d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:31.014108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-dee5f81b-77b9-4a49-9c02-163bfaafc54d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:31.023291 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dee5f81b-77b9-4a49-9c02-163bfaafc54d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:31.023980 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dee5f81b-77b9-4a49-9c02-163bfaafc54d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:31.024819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dee5f81b-77b9-4a49-9c02-163bfaafc54d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:31.025293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dee5f81b-77b9-4a49-9c02-163bfaafc54d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:31.294172 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-dee5f81b-77b9-4a49-9c02-163bfaafc54d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:31.304607 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-dee5f81b-77b9-4a49-9c02-163bfaafc54d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:31.306201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-dee5f81b-77b9-4a49-9c02-163bfaafc54d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:31.307399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-dee5f81b-77b9-4a49-9c02-163bfaafc54d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1740 microversion: 2.20 time: 0.298863 Feb 17 03:33:31.315898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 503/956] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:31 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:31.634899 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ae339cd7-ac18-4199-b61d-d6ffae1187a3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:31.636203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ae339cd7-ac18-4199-b61d-d6ffae1187a3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:31.645119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ae339cd7-ac18-4199-b61d-d6ffae1187a3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:31.645637 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ae339cd7-ac18-4199-b61d-d6ffae1187a3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:31.646506 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ae339cd7-ac18-4199-b61d-d6ffae1187a3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:31.647188 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ae339cd7-ac18-4199-b61d-d6ffae1187a3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:31.813331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ae339cd7-ac18-4199-b61d-d6ffae1187a3 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 31820 microversion: 2.1 time: 0.182560 Feb 17 03:33:31.814376 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 454/957] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:31 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 31820 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:32.328263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-aca7ba70-a650-441a-bdac-12fbcbdf85c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:32.328931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-aca7ba70-a650-441a-bdac-12fbcbdf85c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:32.337141 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aca7ba70-a650-441a-bdac-12fbcbdf85c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:32.337640 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aca7ba70-a650-441a-bdac-12fbcbdf85c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:32.338476 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aca7ba70-a650-441a-bdac-12fbcbdf85c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:32.339472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aca7ba70-a650-441a-bdac-12fbcbdf85c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:32.571342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-aca7ba70-a650-441a-bdac-12fbcbdf85c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:32.581776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-aca7ba70-a650-441a-bdac-12fbcbdf85c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:32.583336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-aca7ba70-a650-441a-bdac-12fbcbdf85c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:32.584845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-aca7ba70-a650-441a-bdac-12fbcbdf85c0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1740 microversion: 2.20 time: 0.260496 Feb 17 03:33:32.585558 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 504/958] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:32 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:32.828210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b31872ed-16c6-498e-9025-341d73a64d4d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:32.829262 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b31872ed-16c6-498e-9025-341d73a64d4d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:32.837851 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b31872ed-16c6-498e-9025-341d73a64d4d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:32.838500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b31872ed-16c6-498e-9025-341d73a64d4d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:32.840050 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b31872ed-16c6-498e-9025-341d73a64d4d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:32.842018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b31872ed-16c6-498e-9025-341d73a64d4d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:32.986129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b31872ed-16c6-498e-9025-341d73a64d4d tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 32864 microversion: 2.1 time: 0.163646 Feb 17 03:33:32.987076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 455/959] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:32 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 32864 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:33.605788 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0a326b28-7fe8-4f72-b1d3-4347f5853585 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:33.606706 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0a326b28-7fe8-4f72-b1d3-4347f5853585 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:33.617558 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a326b28-7fe8-4f72-b1d3-4347f5853585 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:33.618173 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a326b28-7fe8-4f72-b1d3-4347f5853585 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:33.619103 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a326b28-7fe8-4f72-b1d3-4347f5853585 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:33.619696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a326b28-7fe8-4f72-b1d3-4347f5853585 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:33.850749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0a326b28-7fe8-4f72-b1d3-4347f5853585 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:33.862234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0a326b28-7fe8-4f72-b1d3-4347f5853585 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:33.863876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0a326b28-7fe8-4f72-b1d3-4347f5853585 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:33.865064 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0a326b28-7fe8-4f72-b1d3-4347f5853585 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1740 microversion: 2.20 time: 0.264351 Feb 17 03:33:33.867253 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 505/960] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:33 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:33.999913 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ea461e8b-9993-48aa-828c-ab2b2e4043d5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:34.001025 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ea461e8b-9993-48aa-828c-ab2b2e4043d5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:34.010353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ea461e8b-9993-48aa-828c-ab2b2e4043d5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:34.011239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ea461e8b-9993-48aa-828c-ab2b2e4043d5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:34.012362 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ea461e8b-9993-48aa-828c-ab2b2e4043d5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:34.013051 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ea461e8b-9993-48aa-828c-ab2b2e4043d5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:34.164294 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ea461e8b-9993-48aa-828c-ab2b2e4043d5 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 33589 microversion: 2.1 time: 0.168867 Feb 17 03:33:34.166639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 456/961] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:33 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 33589 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:34.887369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e462ef81-a1c3-48b6-ba8d-ff482e031b1d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:34.889076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e462ef81-a1c3-48b6-ba8d-ff482e031b1d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:34.897395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e462ef81-a1c3-48b6-ba8d-ff482e031b1d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:34.897887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e462ef81-a1c3-48b6-ba8d-ff482e031b1d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:34.898714 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e462ef81-a1c3-48b6-ba8d-ff482e031b1d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:34.899210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e462ef81-a1c3-48b6-ba8d-ff482e031b1d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:35.143076 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e462ef81-a1c3-48b6-ba8d-ff482e031b1d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:35.156890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e462ef81-a1c3-48b6-ba8d-ff482e031b1d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:35.158482 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e462ef81-a1c3-48b6-ba8d-ff482e031b1d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:35.159724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e462ef81-a1c3-48b6-ba8d-ff482e031b1d tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1740 microversion: 2.20 time: 0.278939 Feb 17 03:33:35.160318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 506/962] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:34 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:35.183222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-427e8c85-8c02-4160-a42e-7efa4386becf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:35.184719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-427e8c85-8c02-4160-a42e-7efa4386becf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:35.199940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-427e8c85-8c02-4160-a42e-7efa4386becf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:35.199940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-427e8c85-8c02-4160-a42e-7efa4386becf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:35.199940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-427e8c85-8c02-4160-a42e-7efa4386becf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:35.199940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-427e8c85-8c02-4160-a42e-7efa4386becf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:35.354981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-427e8c85-8c02-4160-a42e-7efa4386becf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 34762 microversion: 2.1 time: 0.180180 Feb 17 03:33:35.355648 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 457/963] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:35 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 34762 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:33:36.181116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e6af7b6c-45e4-4306-8601-64d300ed186b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:36.181774 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e6af7b6c-45e4-4306-8601-64d300ed186b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:36.190477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e6af7b6c-45e4-4306-8601-64d300ed186b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:36.190996 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e6af7b6c-45e4-4306-8601-64d300ed186b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:36.191863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e6af7b6c-45e4-4306-8601-64d300ed186b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:36.192373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e6af7b6c-45e4-4306-8601-64d300ed186b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:36.368365 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b83b37c4-8501-4566-a431-0eb18efcd4f7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:36.369726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b83b37c4-8501-4566-a431-0eb18efcd4f7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:36.383344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b83b37c4-8501-4566-a431-0eb18efcd4f7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:36.383894 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b83b37c4-8501-4566-a431-0eb18efcd4f7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:36.385144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b83b37c4-8501-4566-a431-0eb18efcd4f7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:36.385578 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b83b37c4-8501-4566-a431-0eb18efcd4f7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:36.422809 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e6af7b6c-45e4-4306-8601-64d300ed186b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:36.433805 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e6af7b6c-45e4-4306-8601-64d300ed186b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:36.435366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e6af7b6c-45e4-4306-8601-64d300ed186b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:36.436584 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e6af7b6c-45e4-4306-8601-64d300ed186b tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1740 microversion: 2.20 time: 0.259784 Feb 17 03:33:36.437266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 507/964] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:36 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:33:36.546923 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b83b37c4-8501-4566-a431-0eb18efcd4f7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 36005 microversion: 2.1 time: 0.182832 Feb 17 03:33:36.548033 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 458/965] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:36 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 36005 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:37.458608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7d3c4ddf-a8f5-478c-99d3-dbdeb8c675c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:37.459006 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7d3c4ddf-a8f5-478c-99d3-dbdeb8c675c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:37.467628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7d3c4ddf-a8f5-478c-99d3-dbdeb8c675c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:37.468117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7d3c4ddf-a8f5-478c-99d3-dbdeb8c675c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:37.468832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7d3c4ddf-a8f5-478c-99d3-dbdeb8c675c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:37.469449 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7d3c4ddf-a8f5-478c-99d3-dbdeb8c675c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:37.560976 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-14b29e2d-037c-49bc-afc2-aeb46921b0c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:37.562181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-14b29e2d-037c-49bc-afc2-aeb46921b0c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:37.570584 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14b29e2d-037c-49bc-afc2-aeb46921b0c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:37.571100 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14b29e2d-037c-49bc-afc2-aeb46921b0c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:37.574839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14b29e2d-037c-49bc-afc2-aeb46921b0c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:37.574839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14b29e2d-037c-49bc-afc2-aeb46921b0c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:37.737429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7d3c4ddf-a8f5-478c-99d3-dbdeb8c675c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:37.748186 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-14b29e2d-037c-49bc-afc2-aeb46921b0c4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 37152 microversion: 2.1 time: 0.191431 Feb 17 03:33:37.750141 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 459/966] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:37 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 37152 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:37.760602 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7d3c4ddf-a8f5-478c-99d3-dbdeb8c675c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:37.762885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7d3c4ddf-a8f5-478c-99d3-dbdeb8c675c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:37.764223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7d3c4ddf-a8f5-478c-99d3-dbdeb8c675c6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1740 microversion: 2.20 time: 0.310318 Feb 17 03:33:37.765042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 508/967] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:37 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1740 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:38.761951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-86d34dfb-96f0-4d99-8c2b-de2115be5fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:38.763163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-86d34dfb-96f0-4d99-8c2b-de2115be5fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:38.771949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-86d34dfb-96f0-4d99-8c2b-de2115be5fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:38.772499 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-86d34dfb-96f0-4d99-8c2b-de2115be5fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:38.773340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-86d34dfb-96f0-4d99-8c2b-de2115be5fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:38.773830 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-86d34dfb-96f0-4d99-8c2b-de2115be5fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:38.783635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-23c33a6b-e288-4fd6-95df-f6e18f9a52d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:38.784346 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-23c33a6b-e288-4fd6-95df-f6e18f9a52d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:38.792792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23c33a6b-e288-4fd6-95df-f6e18f9a52d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:38.793293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23c33a6b-e288-4fd6-95df-f6e18f9a52d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:38.794122 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23c33a6b-e288-4fd6-95df-f6e18f9a52d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:38.794608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23c33a6b-e288-4fd6-95df-f6e18f9a52d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:38.924010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-86d34dfb-96f0-4d99-8c2b-de2115be5fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 38162 microversion: 2.1 time: 0.166357 Feb 17 03:33:38.928468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 460/968] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:38 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 38162 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:39.008001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-23c33a6b-e288-4fd6-95df-f6e18f9a52d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:39.017619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-23c33a6b-e288-4fd6-95df-f6e18f9a52d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:39.019120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-23c33a6b-e288-4fd6-95df-f6e18f9a52d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:39.020326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-23c33a6b-e288-4fd6-95df-f6e18f9a52d7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1722 microversion: 2.20 time: 0.240963 Feb 17 03:33:39.020917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 509/969] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:38 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:39.937786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7cdedc1f-4fe7-4fa8-a6fc-fe87c344a5c2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:39.938921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7cdedc1f-4fe7-4fa8-a6fc-fe87c344a5c2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:39.947618 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7cdedc1f-4fe7-4fa8-a6fc-fe87c344a5c2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:39.948710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7cdedc1f-4fe7-4fa8-a6fc-fe87c344a5c2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:39.949542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7cdedc1f-4fe7-4fa8-a6fc-fe87c344a5c2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:39.950028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7cdedc1f-4fe7-4fa8-a6fc-fe87c344a5c2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:40.040005 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7d004d1a-fdb7-450f-8d3f-4d42350785b2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:40.040662 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7d004d1a-fdb7-450f-8d3f-4d42350785b2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:40.048440 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7d004d1a-fdb7-450f-8d3f-4d42350785b2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:40.048940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7d004d1a-fdb7-450f-8d3f-4d42350785b2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:40.049752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7d004d1a-fdb7-450f-8d3f-4d42350785b2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:40.050233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7d004d1a-fdb7-450f-8d3f-4d42350785b2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:40.080351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7cdedc1f-4fe7-4fa8-a6fc-fe87c344a5c2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 38162 microversion: 2.1 time: 0.147135 Feb 17 03:33:40.084791 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 461/970] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:39 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 38162 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:40.269935 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7d004d1a-fdb7-450f-8d3f-4d42350785b2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:40.279090 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7d004d1a-fdb7-450f-8d3f-4d42350785b2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:40.280684 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7d004d1a-fdb7-450f-8d3f-4d42350785b2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:40.281851 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7d004d1a-fdb7-450f-8d3f-4d42350785b2 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1722 microversion: 2.20 time: 0.245817 Feb 17 03:33:40.282434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 510/971] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:40 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:33:41.094311 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b0e7557b-e054-4a4b-9681-afe706c5a8da tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:41.095491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b0e7557b-e054-4a4b-9681-afe706c5a8da tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:41.104457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0e7557b-e054-4a4b-9681-afe706c5a8da tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:41.104969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0e7557b-e054-4a4b-9681-afe706c5a8da tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:41.105848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0e7557b-e054-4a4b-9681-afe706c5a8da tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:41.106337 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b0e7557b-e054-4a4b-9681-afe706c5a8da tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:41.231751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b0e7557b-e054-4a4b-9681-afe706c5a8da tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 38162 microversion: 2.1 time: 0.142314 Feb 17 03:33:41.236155 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 462/972] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:41 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 38162 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:41.301700 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3e2add9b-2993-4f4a-a168-d2cea51f3fc0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:41.302358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3e2add9b-2993-4f4a-a168-d2cea51f3fc0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:41.310124 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e2add9b-2993-4f4a-a168-d2cea51f3fc0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:41.310617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e2add9b-2993-4f4a-a168-d2cea51f3fc0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:41.311425 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e2add9b-2993-4f4a-a168-d2cea51f3fc0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:41.311929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e2add9b-2993-4f4a-a168-d2cea51f3fc0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:41.524718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3e2add9b-2993-4f4a-a168-d2cea51f3fc0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:41.533862 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3e2add9b-2993-4f4a-a168-d2cea51f3fc0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:41.535394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3e2add9b-2993-4f4a-a168-d2cea51f3fc0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:41.536574 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3e2add9b-2993-4f4a-a168-d2cea51f3fc0 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1722 microversion: 2.20 time: 0.238847 Feb 17 03:33:41.537148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 511/973] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:41 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:42.110519 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-cceae845-a0be-42d5-9498-e651ab2b5640 req-38438d05-b647-4c2a-abca-e115baa78370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f420e97-ea65-416f-bcb1-3912244b4f06", "name": "network-vif-unplugged", "status": "completed", "tag": "ec0e37c1-8234-4d0f-97f8-aeb6924765b5"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:42.112626 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:33:42.112626 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:33:42.124116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-cceae845-a0be-42d5-9498-e651ab2b5640 req-38438d05-b647-4c2a-abca-e115baa78370 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:42.124653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-cceae845-a0be-42d5-9498-e651ab2b5640 req-38438d05-b647-4c2a-abca-e115baa78370 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:42.141769 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-cceae845-a0be-42d5-9498-e651ab2b5640 req-38438d05-b647-4c2a-abca-e115baa78370 service nova] Creating event network-vif-unplugged:ec0e37c1-8234-4d0f-97f8-aeb6924765b5 for instance 4f420e97-ea65-416f-bcb1-3912244b4f06 on hv-cinder-75996 Feb 17 03:33:42.147062 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-cceae845-a0be-42d5-9498-e651ab2b5640 req-38438d05-b647-4c2a-abca-e115baa78370 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047900 Feb 17 03:33:42.147909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 463/974] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:33:42 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:42.243762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6c76e66f-9697-4133-ab40-9debb80d6b9e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:42.244873 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6c76e66f-9697-4133-ab40-9debb80d6b9e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:42.253160 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c76e66f-9697-4133-ab40-9debb80d6b9e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:42.253257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c76e66f-9697-4133-ab40-9debb80d6b9e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:42.254006 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c76e66f-9697-4133-ab40-9debb80d6b9e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:42.254491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6c76e66f-9697-4133-ab40-9debb80d6b9e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:42.391635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6c76e66f-9697-4133-ab40-9debb80d6b9e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action" status: 200 len: 38291 microversion: 2.1 time: 0.151721 Feb 17 03:33:42.392322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 512/975] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:42 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/action => generated 38291 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:42.404104 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8fb626e7-beb5-470e-beb5-c594e3ff2cc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:42.404735 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8fb626e7-beb5-470e-beb5-c594e3ff2cc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:42.412716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fb626e7-beb5-470e-beb5-c594e3ff2cc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:42.413217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fb626e7-beb5-470e-beb5-c594e3ff2cc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:42.414034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fb626e7-beb5-470e-beb5-c594e3ff2cc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:42.414515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fb626e7-beb5-470e-beb5-c594e3ff2cc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:42.474292 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8fb626e7-beb5-470e-beb5-c594e3ff2cc2 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/ips" status: 200 len: 144 microversion: 2.1 time: 0.075149 Feb 17 03:33:42.474814 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 464/976] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Feb 17 03:33:42 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/ips => generated 144 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:42.556744 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2025d2b6-8a8c-4813-bb2f-a4ca3dccb19e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:42.557652 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2025d2b6-8a8c-4813-bb2f-a4ca3dccb19e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:42.566132 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2025d2b6-8a8c-4813-bb2f-a4ca3dccb19e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:42.566627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2025d2b6-8a8c-4813-bb2f-a4ca3dccb19e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:42.567450 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2025d2b6-8a8c-4813-bb2f-a4ca3dccb19e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:42.567955 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2025d2b6-8a8c-4813-bb2f-a4ca3dccb19e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:42.785741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2025d2b6-8a8c-4813-bb2f-a4ca3dccb19e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:42.795268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2025d2b6-8a8c-4813-bb2f-a4ca3dccb19e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:42.796874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2025d2b6-8a8c-4813-bb2f-a4ca3dccb19e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:42.798189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2025d2b6-8a8c-4813-bb2f-a4ca3dccb19e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1665 microversion: 2.20 time: 0.245953 Feb 17 03:33:42.798957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 513/977] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:42 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1665 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:42.817576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3c20336a-08ec-47bb-9520-9b6ac1049854 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27c8aaf7-53e7-41bf-b9da-65d25aa27ebd"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:42.818873 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3c20336a-08ec-47bb-9520-9b6ac1049854 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:42.830613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c20336a-08ec-47bb-9520-9b6ac1049854 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:42.831132 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c20336a-08ec-47bb-9520-9b6ac1049854 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:42.832024 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c20336a-08ec-47bb-9520-9b6ac1049854 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:42.832530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3c20336a-08ec-47bb-9520-9b6ac1049854 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:43.262887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3c20336a-08ec-47bb-9520-9b6ac1049854 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.449619 Feb 17 03:33:43.263624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 465/978] 10.222.0.46 () {62 vars in 1354 bytes} [Wed Feb 17 03:33:42 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/os-volume_attachments => generated 188 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:33:43.373525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9bd4bd3f-6ba5-4ba4-8ccb-8849e788fb01 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:43.374067 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9bd4bd3f-6ba5-4ba4-8ccb-8849e788fb01 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:43.381795 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bd4bd3f-6ba5-4ba4-8ccb-8849e788fb01 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:43.382292 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bd4bd3f-6ba5-4ba4-8ccb-8849e788fb01 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:43.383110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bd4bd3f-6ba5-4ba4-8ccb-8849e788fb01 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:43.383619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bd4bd3f-6ba5-4ba4-8ccb-8849e788fb01 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:43.849159 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9bd4bd3f-6ba5-4ba4-8ccb-8849e788fb01 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/os-volume_attachments/27c8aaf7-53e7-41bf-b9da-65d25aa27ebd" status: 202 len: 0 microversion: 2.20 time: 0.480160 Feb 17 03:33:43.849869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 514/979] 10.222.0.46 () {60 vars in 1447 bytes} [Wed Feb 17 03:33:43 2021] DELETE /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/os-volume_attachments/27c8aaf7-53e7-41bf-b9da-65d25aa27ebd => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:33:43.953598 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9b9023d2-aaaa-4775-816b-721dedb3b492 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:43.954181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9b9023d2-aaaa-4775-816b-721dedb3b492 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:43.961884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9b9023d2-aaaa-4775-816b-721dedb3b492 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:43.962384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9b9023d2-aaaa-4775-816b-721dedb3b492 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:43.963197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9b9023d2-aaaa-4775-816b-721dedb3b492 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:43.963756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9b9023d2-aaaa-4775-816b-721dedb3b492 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:44.048926 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7b9bc141-5da0-4c25-8bbe-c7673ebe1a2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "386b6c7f-86ca-4172-8744-384efb1f7589"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:44.050110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7b9bc141-5da0-4c25-8bbe-c7673ebe1a2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:44.058656 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7b9bc141-5da0-4c25-8bbe-c7673ebe1a2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:44.059151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7b9bc141-5da0-4c25-8bbe-c7673ebe1a2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:44.059999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7b9bc141-5da0-4c25-8bbe-c7673ebe1a2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:44.060481 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7b9bc141-5da0-4c25-8bbe-c7673ebe1a2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:44.121530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9b9023d2-aaaa-4775-816b-721dedb3b492 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action" status: 202 len: 0 microversion: 2.20 time: 0.172057 Feb 17 03:33:44.122423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 466/980] 10.222.0.46 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:43 2021] POST /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:33:44.130840 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-740a8a03-5ab3-45a0-8a20-bf2389b50f11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:44.131501 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-740a8a03-5ab3-45a0-8a20-bf2389b50f11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:44.140813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-740a8a03-5ab3-45a0-8a20-bf2389b50f11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:44.141316 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-740a8a03-5ab3-45a0-8a20-bf2389b50f11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:44.142153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-740a8a03-5ab3-45a0-8a20-bf2389b50f11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:44.142643 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-740a8a03-5ab3-45a0-8a20-bf2389b50f11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:44.488885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7b9bc141-5da0-4c25-8bbe-c7673ebe1a2c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443797 Feb 17 03:33:44.489653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 515/981] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:33:44 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:44.602091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-740a8a03-5ab3-45a0-8a20-bf2389b50f11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:44.613579 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-740a8a03-5ab3-45a0-8a20-bf2389b50f11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:44.616078 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-740a8a03-5ab3-45a0-8a20-bf2389b50f11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:44.617993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-740a8a03-5ab3-45a0-8a20-bf2389b50f11 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1673 microversion: 2.20 time: 0.490997 Feb 17 03:33:44.618685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 467/982] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:44 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1673 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:33:45.645412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0a969a5d-1c94-4223-a23f-a9ad2c9194da tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:45.646178 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0a969a5d-1c94-4223-a23f-a9ad2c9194da tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:45.655030 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a969a5d-1c94-4223-a23f-a9ad2c9194da tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:45.655559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a969a5d-1c94-4223-a23f-a9ad2c9194da tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:45.656398 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a969a5d-1c94-4223-a23f-a9ad2c9194da tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:45.656892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0a969a5d-1c94-4223-a23f-a9ad2c9194da tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:45.875967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0a969a5d-1c94-4223-a23f-a9ad2c9194da tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:45.885454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0a969a5d-1c94-4223-a23f-a9ad2c9194da tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:45.887007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0a969a5d-1c94-4223-a23f-a9ad2c9194da tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:45.888250 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0a969a5d-1c94-4223-a23f-a9ad2c9194da tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1675 microversion: 2.20 time: 0.247836 Feb 17 03:33:45.888843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 516/983] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:45 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1675 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:46.908657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-558a8ec7-ca41-4bda-baa5-382272388d58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:46.909307 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-558a8ec7-ca41-4bda-baa5-382272388d58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:46.919217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-558a8ec7-ca41-4bda-baa5-382272388d58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:46.919753 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-558a8ec7-ca41-4bda-baa5-382272388d58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:46.920599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-558a8ec7-ca41-4bda-baa5-382272388d58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:46.921075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-558a8ec7-ca41-4bda-baa5-382272388d58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:47.131380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-558a8ec7-ca41-4bda-baa5-382272388d58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:47.142151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-558a8ec7-ca41-4bda-baa5-382272388d58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:47.143933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-558a8ec7-ca41-4bda-baa5-382272388d58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:47.145129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-558a8ec7-ca41-4bda-baa5-382272388d58 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.240574 Feb 17 03:33:47.145724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 468/984] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:46 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:48.165875 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d06ec1a5-2274-41c2-919a-d37e3ac512f1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:48.166552 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d06ec1a5-2274-41c2-919a-d37e3ac512f1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:48.176230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d06ec1a5-2274-41c2-919a-d37e3ac512f1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:48.176734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d06ec1a5-2274-41c2-919a-d37e3ac512f1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:48.177572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d06ec1a5-2274-41c2-919a-d37e3ac512f1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:48.178065 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d06ec1a5-2274-41c2-919a-d37e3ac512f1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:48.399721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d06ec1a5-2274-41c2-919a-d37e3ac512f1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:48.410165 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d06ec1a5-2274-41c2-919a-d37e3ac512f1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:48.411347 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d06ec1a5-2274-41c2-919a-d37e3ac512f1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:48.412580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d06ec1a5-2274-41c2-919a-d37e3ac512f1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.250919 Feb 17 03:33:48.413163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 517/985] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:48 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:49.434150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ccd3257d-1bf7-4ed5-8685-02cba7a820a1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:49.434824 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ccd3257d-1bf7-4ed5-8685-02cba7a820a1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:49.442909 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ccd3257d-1bf7-4ed5-8685-02cba7a820a1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:49.443407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ccd3257d-1bf7-4ed5-8685-02cba7a820a1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:49.444267 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ccd3257d-1bf7-4ed5-8685-02cba7a820a1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:49.444762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ccd3257d-1bf7-4ed5-8685-02cba7a820a1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:49.668235 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ccd3257d-1bf7-4ed5-8685-02cba7a820a1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:49.678177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ccd3257d-1bf7-4ed5-8685-02cba7a820a1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:49.679784 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ccd3257d-1bf7-4ed5-8685-02cba7a820a1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:49.680981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ccd3257d-1bf7-4ed5-8685-02cba7a820a1 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.251513 Feb 17 03:33:49.681805 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 469/986] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:49 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:50.701389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a2a2d238-15a2-49d8-9420-031aceabad95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:50.702084 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a2a2d238-15a2-49d8-9420-031aceabad95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:50.710093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2a2d238-15a2-49d8-9420-031aceabad95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:50.710585 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2a2d238-15a2-49d8-9420-031aceabad95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:50.711407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2a2d238-15a2-49d8-9420-031aceabad95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:50.711916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a2a2d238-15a2-49d8-9420-031aceabad95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:50.940284 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a2a2d238-15a2-49d8-9420-031aceabad95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:50.950376 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a2a2d238-15a2-49d8-9420-031aceabad95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:50.952023 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a2a2d238-15a2-49d8-9420-031aceabad95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:50.953153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a2a2d238-15a2-49d8-9420-031aceabad95 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.256405 Feb 17 03:33:50.953795 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 518/987] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:50 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:51.974257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f89ccffd-7e7c-43b6-97d3-080f2a69c0a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:51.974978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f89ccffd-7e7c-43b6-97d3-080f2a69c0a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:51.984467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f89ccffd-7e7c-43b6-97d3-080f2a69c0a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:51.985010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f89ccffd-7e7c-43b6-97d3-080f2a69c0a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:51.985854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f89ccffd-7e7c-43b6-97d3-080f2a69c0a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:51.986340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f89ccffd-7e7c-43b6-97d3-080f2a69c0a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:52.220080 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f89ccffd-7e7c-43b6-97d3-080f2a69c0a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:52.231424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f89ccffd-7e7c-43b6-97d3-080f2a69c0a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:52.232944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f89ccffd-7e7c-43b6-97d3-080f2a69c0a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:52.235066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f89ccffd-7e7c-43b6-97d3-080f2a69c0a7 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.264802 Feb 17 03:33:52.235924 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 470/988] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:51 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:53.255156 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3041406b-f938-4ad1-94d0-95626ffd3914 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:53.256488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3041406b-f938-4ad1-94d0-95626ffd3914 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:53.266352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3041406b-f938-4ad1-94d0-95626ffd3914 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:53.266945 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3041406b-f938-4ad1-94d0-95626ffd3914 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:53.267814 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3041406b-f938-4ad1-94d0-95626ffd3914 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:53.268423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3041406b-f938-4ad1-94d0-95626ffd3914 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:53.513207 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3041406b-f938-4ad1-94d0-95626ffd3914 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:53.522940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3041406b-f938-4ad1-94d0-95626ffd3914 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:53.528913 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3041406b-f938-4ad1-94d0-95626ffd3914 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:53.530142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3041406b-f938-4ad1-94d0-95626ffd3914 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.279084 Feb 17 03:33:53.530873 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 519/989] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:53 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:54.550088 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-89a10acb-b34e-4dd3-a17e-8f5a295c4c64 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:54.551181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-89a10acb-b34e-4dd3-a17e-8f5a295c4c64 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:54.559410 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89a10acb-b34e-4dd3-a17e-8f5a295c4c64 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:54.560273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89a10acb-b34e-4dd3-a17e-8f5a295c4c64 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:54.561461 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89a10acb-b34e-4dd3-a17e-8f5a295c4c64 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:54.562182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89a10acb-b34e-4dd3-a17e-8f5a295c4c64 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:54.791957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-89a10acb-b34e-4dd3-a17e-8f5a295c4c64 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:54.801614 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-89a10acb-b34e-4dd3-a17e-8f5a295c4c64 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:54.803234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-89a10acb-b34e-4dd3-a17e-8f5a295c4c64 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:54.804562 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-89a10acb-b34e-4dd3-a17e-8f5a295c4c64 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.258494 Feb 17 03:33:54.805191 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 471/990] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:54 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:55.824996 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-424eafc6-fc55-4878-8c0b-4461bdab06bd tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:55.825652 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-424eafc6-fc55-4878-8c0b-4461bdab06bd tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:55.833820 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-424eafc6-fc55-4878-8c0b-4461bdab06bd tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:55.834322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-424eafc6-fc55-4878-8c0b-4461bdab06bd tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:55.835168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-424eafc6-fc55-4878-8c0b-4461bdab06bd tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:55.835711 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-424eafc6-fc55-4878-8c0b-4461bdab06bd tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:56.063801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-424eafc6-fc55-4878-8c0b-4461bdab06bd tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:56.073958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-424eafc6-fc55-4878-8c0b-4461bdab06bd tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:56.075633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-424eafc6-fc55-4878-8c0b-4461bdab06bd tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:56.076822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-424eafc6-fc55-4878-8c0b-4461bdab06bd tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.255924 Feb 17 03:33:56.077403 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 520/991] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:55 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:57.097529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c52f803a-c8fb-4d00-b1f0-072f989a7184 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:57.098124 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c52f803a-c8fb-4d00-b1f0-072f989a7184 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:57.106885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c52f803a-c8fb-4d00-b1f0-072f989a7184 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:57.107389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c52f803a-c8fb-4d00-b1f0-072f989a7184 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:57.108254 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c52f803a-c8fb-4d00-b1f0-072f989a7184 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:57.108764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c52f803a-c8fb-4d00-b1f0-072f989a7184 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:57.319389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c52f803a-c8fb-4d00-b1f0-072f989a7184 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:57.328719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c52f803a-c8fb-4d00-b1f0-072f989a7184 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:57.330278 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c52f803a-c8fb-4d00-b1f0-072f989a7184 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:57.331461 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c52f803a-c8fb-4d00-b1f0-072f989a7184 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.238042 Feb 17 03:33:57.332068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 472/992] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:57 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:58.363158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1bf43d48-b549-439a-96a7-589464683778 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:58.364724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1bf43d48-b549-439a-96a7-589464683778 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:58.389994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bf43d48-b549-439a-96a7-589464683778 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:58.391014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bf43d48-b549-439a-96a7-589464683778 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:58.394530 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bf43d48-b549-439a-96a7-589464683778 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:58.396083 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bf43d48-b549-439a-96a7-589464683778 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:58.639802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1bf43d48-b549-439a-96a7-589464683778 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:58.649099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1bf43d48-b549-439a-96a7-589464683778 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:58.650666 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1bf43d48-b549-439a-96a7-589464683778 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:58.651948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1bf43d48-b549-439a-96a7-589464683778 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.301989 Feb 17 03:33:58.652540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 521/993] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:58 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:59.060024 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8331ac69-1d33-4541-a2bc-13f32052fb3c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:59.061135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8331ac69-1d33-4541-a2bc-13f32052fb3c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:59.068876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8331ac69-1d33-4541-a2bc-13f32052fb3c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:59.069373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8331ac69-1d33-4541-a2bc-13f32052fb3c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:59.070194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8331ac69-1d33-4541-a2bc-13f32052fb3c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:59.070675 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8331ac69-1d33-4541-a2bc-13f32052fb3c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:59.137394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8331ac69-1d33-4541-a2bc-13f32052fb3c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082086 Feb 17 03:33:59.137990 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 473/994] 10.222.0.46 () {58 vars in 1292 bytes} [Wed Feb 17 03:33:59 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:59.148554 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bb043cdb-e51f-41fb-adcc-72e329b761cf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:59.149134 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bb043cdb-e51f-41fb-adcc-72e329b761cf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:59.156916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb043cdb-e51f-41fb-adcc-72e329b761cf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:59.157411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb043cdb-e51f-41fb-adcc-72e329b761cf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:59.158228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb043cdb-e51f-41fb-adcc-72e329b761cf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:59.158718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bb043cdb-e51f-41fb-adcc-72e329b761cf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:59.227121 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bb043cdb-e51f-41fb-adcc-72e329b761cf tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments/386b6c7f-86ca-4172-8744-384efb1f7589" status: 200 len: 194 microversion: 2.1 time: 0.082326 Feb 17 03:33:59.227721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 522/995] 10.222.0.46 () {58 vars in 1403 bytes} [Wed Feb 17 03:33:59 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments/386b6c7f-86ca-4172-8744-384efb1f7589 => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:59.671129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6bd371dd-065c-4b92-864f-ed54a3a1b661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:59.671853 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6bd371dd-065c-4b92-864f-ed54a3a1b661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:59.679456 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6bd371dd-065c-4b92-864f-ed54a3a1b661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:59.679992 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6bd371dd-065c-4b92-864f-ed54a3a1b661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:59.680803 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6bd371dd-065c-4b92-864f-ed54a3a1b661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:59.681286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6bd371dd-065c-4b92-864f-ed54a3a1b661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:59.892269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6bd371dd-065c-4b92-864f-ed54a3a1b661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:59.901434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6bd371dd-065c-4b92-864f-ed54a3a1b661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:59.903037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6bd371dd-065c-4b92-864f-ed54a3a1b661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:59.904259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6bd371dd-065c-4b92-864f-ed54a3a1b661 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.237788 Feb 17 03:33:59.904832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 474/996] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:59 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:00.777642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-dcae1c07-f955-4bc9-991b-462ee191135e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7c14939-71d1-4f45-9644-2b5cf17369aa"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:34:00.778969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-dcae1c07-f955-4bc9-991b-462ee191135e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:00.787218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dcae1c07-f955-4bc9-991b-462ee191135e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:00.787786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dcae1c07-f955-4bc9-991b-462ee191135e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:00.788606 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dcae1c07-f955-4bc9-991b-462ee191135e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:00.789098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-dcae1c07-f955-4bc9-991b-462ee191135e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:00.887755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-861407b4-938f-49e8-9ea9-b1bc39422329 req-3333dad7-b9d8-47af-bad8-28b79eb7c6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f420e97-ea65-416f-bcb1-3912244b4f06", "name": "network-vif-plugged", "status": "completed", "tag": "ec0e37c1-8234-4d0f-97f8-aeb6924765b5"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:34:00.889893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:34:00.889893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:34:00.904260 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-861407b4-938f-49e8-9ea9-b1bc39422329 req-3333dad7-b9d8-47af-bad8-28b79eb7c6e4 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:00.904865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-861407b4-938f-49e8-9ea9-b1bc39422329 req-3333dad7-b9d8-47af-bad8-28b79eb7c6e4 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:00.922482 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-861407b4-938f-49e8-9ea9-b1bc39422329 req-3333dad7-b9d8-47af-bad8-28b79eb7c6e4 service nova] Creating event network-vif-plugged:ec0e37c1-8234-4d0f-97f8-aeb6924765b5 for instance 4f420e97-ea65-416f-bcb1-3912244b4f06 on hv-cinder-75996 Feb 17 03:34:00.928312 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-861407b4-938f-49e8-9ea9-b1bc39422329 req-3333dad7-b9d8-47af-bad8-28b79eb7c6e4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044909 Feb 17 03:34:00.928465 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 475/997] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:34:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:34:00.934537 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-389191d0-b4fa-4b37-b850-0c377878c1ae tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:00.935360 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-389191d0-b4fa-4b37-b850-0c377878c1ae tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:00.943444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-389191d0-b4fa-4b37-b850-0c377878c1ae tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:00.943867 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-389191d0-b4fa-4b37-b850-0c377878c1ae tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:00.944696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-389191d0-b4fa-4b37-b850-0c377878c1ae tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:00.945180 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-389191d0-b4fa-4b37-b850-0c377878c1ae tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:01.171552 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-389191d0-b4fa-4b37-b850-0c377878c1ae tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:01.182681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-389191d0-b4fa-4b37-b850-0c377878c1ae tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:01.184322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-389191d0-b4fa-4b37-b850-0c377878c1ae tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:01.185505 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-389191d0-b4fa-4b37-b850-0c377878c1ae tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.255711 Feb 17 03:34:01.186080 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 476/998] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:00 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:01.203818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-dcae1c07-f955-4bc9-991b-462ee191135e tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430432 Feb 17 03:34:01.209423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 523/999] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:34:00 2021] POST /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments => generated 194 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:34:02.205351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-762cc1d0-af48-43ff-b927-2de8cc0ca071 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:02.206018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-762cc1d0-af48-43ff-b927-2de8cc0ca071 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:02.214611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-762cc1d0-af48-43ff-b927-2de8cc0ca071 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:02.215646 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-762cc1d0-af48-43ff-b927-2de8cc0ca071 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:02.216494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-762cc1d0-af48-43ff-b927-2de8cc0ca071 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:02.216991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-762cc1d0-af48-43ff-b927-2de8cc0ca071 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:02.441259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-762cc1d0-af48-43ff-b927-2de8cc0ca071 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:02.451597 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-762cc1d0-af48-43ff-b927-2de8cc0ca071 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:02.453259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-762cc1d0-af48-43ff-b927-2de8cc0ca071 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:02.454448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-762cc1d0-af48-43ff-b927-2de8cc0ca071 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1731 microversion: 2.20 time: 0.253226 Feb 17 03:34:02.455038 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 477/1000] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:02 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:03.475763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9049623a-4e74-4e28-b586-d662dedf0452 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:03.476509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9049623a-4e74-4e28-b586-d662dedf0452 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:03.489411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9049623a-4e74-4e28-b586-d662dedf0452 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:03.489913 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9049623a-4e74-4e28-b586-d662dedf0452 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:03.490741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9049623a-4e74-4e28-b586-d662dedf0452 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:03.491226 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9049623a-4e74-4e28-b586-d662dedf0452 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:03.701273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9049623a-4e74-4e28-b586-d662dedf0452 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:03.710972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9049623a-4e74-4e28-b586-d662dedf0452 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:03.712552 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9049623a-4e74-4e28-b586-d662dedf0452 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:03.713714 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9049623a-4e74-4e28-b586-d662dedf0452 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1718 microversion: 2.20 time: 0.243245 Feb 17 03:34:03.714303 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 524/1001] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:03 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1718 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:04.100468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3288a2ce-8b1f-401c-bbc9-0bce147344e6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:34:04.103125 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3288a2ce-8b1f-401c-bbc9-0bce147344e6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:04.110030 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3288a2ce-8b1f-401c-bbc9-0bce147344e6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:04.110532 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3288a2ce-8b1f-401c-bbc9-0bce147344e6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:04.111366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3288a2ce-8b1f-401c-bbc9-0bce147344e6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:04.111887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3288a2ce-8b1f-401c-bbc9-0bce147344e6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:04.174062 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-3288a2ce-8b1f-401c-bbc9-0bce147344e6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lazy-loading 'flavor' on Instance uuid 053ba632-5ab2-451f-96b5-adff294a7cb7 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:34:04.327237 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3288a2ce-8b1f-401c-bbc9-0bce147344e6 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "POST /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7/action" status: 202 len: 0 microversion: 2.1 time: 0.230724 Feb 17 03:34:04.328022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 478/1002] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:34:04 2021] POST /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:34:04.336940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-322eb58f-8d21-41ba-9500-a7916ef5f0ff tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:04.337698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-322eb58f-8d21-41ba-9500-a7916ef5f0ff tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:04.346328 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-322eb58f-8d21-41ba-9500-a7916ef5f0ff tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:04.346830 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-322eb58f-8d21-41ba-9500-a7916ef5f0ff tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:04.347684 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-322eb58f-8d21-41ba-9500-a7916ef5f0ff tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:04.348237 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-322eb58f-8d21-41ba-9500-a7916ef5f0ff tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:04.555280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-322eb58f-8d21-41ba-9500-a7916ef5f0ff tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:04.564948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-322eb58f-8d21-41ba-9500-a7916ef5f0ff tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1572 microversion: 2.1 time: 0.232149 Feb 17 03:34:04.565550 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 525/1003] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:04 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1572 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:05.584522 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d148ab56-eb89-48b0-b635-668e54af59e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:05.585228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d148ab56-eb89-48b0-b635-668e54af59e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:05.593903 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d148ab56-eb89-48b0-b635-668e54af59e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:05.594399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d148ab56-eb89-48b0-b635-668e54af59e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:05.595230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d148ab56-eb89-48b0-b635-668e54af59e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:05.595752 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d148ab56-eb89-48b0-b635-668e54af59e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:05.808951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d148ab56-eb89-48b0-b635-668e54af59e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:05.817880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d148ab56-eb89-48b0-b635-668e54af59e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1572 microversion: 2.1 time: 0.238045 Feb 17 03:34:05.818479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 479/1004] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:05 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1572 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:06.837207 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2abc4145-e45e-4186-9206-5c8c89ee9ad7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:06.837880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2abc4145-e45e-4186-9206-5c8c89ee9ad7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:06.847019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2abc4145-e45e-4186-9206-5c8c89ee9ad7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:06.847537 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2abc4145-e45e-4186-9206-5c8c89ee9ad7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:06.848371 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2abc4145-e45e-4186-9206-5c8c89ee9ad7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:06.848856 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2abc4145-e45e-4186-9206-5c8c89ee9ad7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:07.059754 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2abc4145-e45e-4186-9206-5c8c89ee9ad7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:07.068563 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2abc4145-e45e-4186-9206-5c8c89ee9ad7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1572 microversion: 2.1 time: 0.235374 Feb 17 03:34:07.069163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 526/1005] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:06 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1572 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:08.086556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-46c5ca40-1293-4197-b975-da7ca6583476 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:08.087228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-46c5ca40-1293-4197-b975-da7ca6583476 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:08.094981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46c5ca40-1293-4197-b975-da7ca6583476 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:08.095479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46c5ca40-1293-4197-b975-da7ca6583476 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:08.096351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46c5ca40-1293-4197-b975-da7ca6583476 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:08.096839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46c5ca40-1293-4197-b975-da7ca6583476 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:08.319854 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-46c5ca40-1293-4197-b975-da7ca6583476 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:08.328911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-46c5ca40-1293-4197-b975-da7ca6583476 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1572 microversion: 2.1 time: 0.246351 Feb 17 03:34:08.329511 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 480/1006] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:08 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1572 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:09.046939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5712656d-b58a-4759-b9a0-745bf11d6860 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:09.048140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5712656d-b58a-4759-b9a0-745bf11d6860 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:09.055976 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5712656d-b58a-4759-b9a0-745bf11d6860 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:09.056472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5712656d-b58a-4759-b9a0-745bf11d6860 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:09.057384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5712656d-b58a-4759-b9a0-745bf11d6860 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:09.057862 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5712656d-b58a-4759-b9a0-745bf11d6860 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:09.129285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5712656d-b58a-4759-b9a0-745bf11d6860 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.086486 Feb 17 03:34:09.129868 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 527/1007] 10.222.0.46 () {58 vars in 1292 bytes} [Wed Feb 17 03:34:09 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments => generated 371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:34:09.347826 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6d136275-52e8-4e7c-b1d6-5f21d2381746 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:09.348494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6d136275-52e8-4e7c-b1d6-5f21d2381746 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:09.356734 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6d136275-52e8-4e7c-b1d6-5f21d2381746 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:09.357240 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6d136275-52e8-4e7c-b1d6-5f21d2381746 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:09.358190 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6d136275-52e8-4e7c-b1d6-5f21d2381746 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:09.358719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6d136275-52e8-4e7c-b1d6-5f21d2381746 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:09.425815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3e18caed-67cc-4d17-ab4c-2d97b9ae6385 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:09.426352 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3e18caed-67cc-4d17-ab4c-2d97b9ae6385 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:09.434708 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e18caed-67cc-4d17-ab4c-2d97b9ae6385 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:09.435201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e18caed-67cc-4d17-ab4c-2d97b9ae6385 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:09.436053 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e18caed-67cc-4d17-ab4c-2d97b9ae6385 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:09.436535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3e18caed-67cc-4d17-ab4c-2d97b9ae6385 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:09.508065 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3e18caed-67cc-4d17-ab4c-2d97b9ae6385 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments/386b6c7f-86ca-4172-8744-384efb1f7589" status: 200 len: 194 microversion: 2.1 time: 0.086133 Feb 17 03:34:09.508640 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 528/1008] 10.222.0.46 () {58 vars in 1403 bytes} [Wed Feb 17 03:34:09 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments/386b6c7f-86ca-4172-8744-384efb1f7589 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:34:09.518504 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e1f0b92b-4994-4f44-addc-75f4b39c01c7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:09.519043 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e1f0b92b-4994-4f44-addc-75f4b39c01c7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:09.526775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e1f0b92b-4994-4f44-addc-75f4b39c01c7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:09.527274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e1f0b92b-4994-4f44-addc-75f4b39c01c7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:09.528126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e1f0b92b-4994-4f44-addc-75f4b39c01c7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:09.528609 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e1f0b92b-4994-4f44-addc-75f4b39c01c7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:09.571011 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6d136275-52e8-4e7c-b1d6-5f21d2381746 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:09.579945 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6d136275-52e8-4e7c-b1d6-5f21d2381746 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1572 microversion: 2.1 time: 0.236083 Feb 17 03:34:09.580540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 481/1009] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:09 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1572 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:09.698813 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-e1f0b92b-4994-4f44-addc-75f4b39c01c7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lazy-loading 'services' on Instance uuid 73390732-5d83-45e6-a650-228f06ea5210 {{(pid=98183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:34:09.962611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e1f0b92b-4994-4f44-addc-75f4b39c01c7 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "DELETE /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments/386b6c7f-86ca-4172-8744-384efb1f7589" status: 202 len: 0 microversion: 2.1 time: 0.447707 Feb 17 03:34:09.963243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 529/1010] 10.222.0.46 () {58 vars in 1406 bytes} [Wed Feb 17 03:34:09 2021] DELETE /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments/386b6c7f-86ca-4172-8744-384efb1f7589 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:34:10.598200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cf132ee8-335d-483b-9621-48d8766a0d85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:10.598863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cf132ee8-335d-483b-9621-48d8766a0d85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:10.607541 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf132ee8-335d-483b-9621-48d8766a0d85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:10.608107 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf132ee8-335d-483b-9621-48d8766a0d85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:10.608927 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf132ee8-335d-483b-9621-48d8766a0d85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:10.609409 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cf132ee8-335d-483b-9621-48d8766a0d85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:10.813786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cf132ee8-335d-483b-9621-48d8766a0d85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:10.822487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cf132ee8-335d-483b-9621-48d8766a0d85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1572 microversion: 2.1 time: 0.228363 Feb 17 03:34:10.823081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 482/1011] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:10 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1572 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:11.842601 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b2ab9b65-c25c-4e8d-8fd4-a13f4e484b30 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:11.843301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b2ab9b65-c25c-4e8d-8fd4-a13f4e484b30 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:11.851381 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b2ab9b65-c25c-4e8d-8fd4-a13f4e484b30 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:11.852170 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b2ab9b65-c25c-4e8d-8fd4-a13f4e484b30 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:11.852991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b2ab9b65-c25c-4e8d-8fd4-a13f4e484b30 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:11.853473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b2ab9b65-c25c-4e8d-8fd4-a13f4e484b30 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:12.062873 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b2ab9b65-c25c-4e8d-8fd4-a13f4e484b30 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:12.071647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b2ab9b65-c25c-4e8d-8fd4-a13f4e484b30 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1572 microversion: 2.1 time: 0.234712 Feb 17 03:34:12.072252 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 530/1012] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:11 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1572 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:12.271819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f53895cf-6bea-416c-996a-004f18bfd223 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:12.272351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f53895cf-6bea-416c-996a-004f18bfd223 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:12.280637 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f53895cf-6bea-416c-996a-004f18bfd223 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:12.281135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f53895cf-6bea-416c-996a-004f18bfd223 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:12.281948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f53895cf-6bea-416c-996a-004f18bfd223 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:12.282429 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f53895cf-6bea-416c-996a-004f18bfd223 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:12.361025 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f53895cf-6bea-416c-996a-004f18bfd223 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments/a7c14939-71d1-4f45-9644-2b5cf17369aa" status: 200 len: 194 microversion: 2.1 time: 0.093314 Feb 17 03:34:12.361670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 483/1013] 10.222.0.46 () {58 vars in 1403 bytes} [Wed Feb 17 03:34:12 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments/a7c14939-71d1-4f45-9644-2b5cf17369aa => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:34:12.372375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c67ab9f2-45a2-40dd-8a04-90cc76d380d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:12.372919 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c67ab9f2-45a2-40dd-8a04-90cc76d380d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:12.380703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c67ab9f2-45a2-40dd-8a04-90cc76d380d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:12.381204 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c67ab9f2-45a2-40dd-8a04-90cc76d380d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:12.382024 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c67ab9f2-45a2-40dd-8a04-90cc76d380d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:12.382513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c67ab9f2-45a2-40dd-8a04-90cc76d380d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:12.554781 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-c67ab9f2-45a2-40dd-8a04-90cc76d380d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lazy-loading 'services' on Instance uuid 73390732-5d83-45e6-a650-228f06ea5210 {{(pid=98183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:34:12.695956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c67ab9f2-45a2-40dd-8a04-90cc76d380d1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "DELETE /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments/a7c14939-71d1-4f45-9644-2b5cf17369aa" status: 202 len: 0 microversion: 2.1 time: 0.327565 Feb 17 03:34:12.696714 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 531/1014] 10.222.0.46 () {58 vars in 1406 bytes} [Wed Feb 17 03:34:12 2021] DELETE /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210/os-volume_attachments/a7c14939-71d1-4f45-9644-2b5cf17369aa => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:34:13.089886 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0aa55c07-feb0-4024-bb61-7486079c5d97 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:13.090487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0aa55c07-feb0-4024-bb61-7486079c5d97 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:13.098288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0aa55c07-feb0-4024-bb61-7486079c5d97 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:13.098785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0aa55c07-feb0-4024-bb61-7486079c5d97 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:13.099642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0aa55c07-feb0-4024-bb61-7486079c5d97 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:13.100136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0aa55c07-feb0-4024-bb61-7486079c5d97 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:13.314984 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0aa55c07-feb0-4024-bb61-7486079c5d97 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:13.323899 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0aa55c07-feb0-4024-bb61-7486079c5d97 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1572 microversion: 2.1 time: 0.238125 Feb 17 03:34:13.324496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 484/1015] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:13 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1572 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:14.277149 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-78109367-3854-4c40-b753-9f030c3244a6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:14.277794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-78109367-3854-4c40-b753-9f030c3244a6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:14.285888 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-78109367-3854-4c40-b753-9f030c3244a6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:14.286389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-78109367-3854-4c40-b753-9f030c3244a6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:14.287205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-78109367-3854-4c40-b753-9f030c3244a6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:14.287721 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-78109367-3854-4c40-b753-9f030c3244a6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:14.342789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ce9263d0-af32-4f76-877d-76c5cb6b3b8c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:14.343455 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ce9263d0-af32-4f76-877d-76c5cb6b3b8c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:14.351265 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ce9263d0-af32-4f76-877d-76c5cb6b3b8c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:14.352087 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ce9263d0-af32-4f76-877d-76c5cb6b3b8c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:14.352921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ce9263d0-af32-4f76-877d-76c5cb6b3b8c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:14.353413 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ce9263d0-af32-4f76-877d-76c5cb6b3b8c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:14.353900 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-78109367-3854-4c40-b753-9f030c3244a6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Going to try to terminate instance {{(pid=98183) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:34:14.471483 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-78109367-3854-4c40-b753-9f030c3244a6 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "DELETE /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 204 len: 0 microversion: 2.1 time: 0.199009 Feb 17 03:34:14.472361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 532/1016] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:34:14 2021] DELETE /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:34:14.481542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d06520b2-8808-4c2d-ae11-2a3329cd950c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:14.482228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d06520b2-8808-4c2d-ae11-2a3329cd950c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:14.490278 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d06520b2-8808-4c2d-ae11-2a3329cd950c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:14.490778 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d06520b2-8808-4c2d-ae11-2a3329cd950c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:14.491635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d06520b2-8808-4c2d-ae11-2a3329cd950c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:14.492121 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d06520b2-8808-4c2d-ae11-2a3329cd950c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:14.571829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ce9263d0-af32-4f76-877d-76c5cb6b3b8c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:14.581211 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ce9263d0-af32-4f76-877d-76c5cb6b3b8c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1572 microversion: 2.1 time: 0.243073 Feb 17 03:34:14.581818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 485/1017] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:14 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1572 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:34:14.710630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d06520b2-8808-4c2d-ae11-2a3329cd950c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:14.720332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d06520b2-8808-4c2d-ae11-2a3329cd950c tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1672 microversion: 2.1 time: 0.243382 Feb 17 03:34:14.720948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 533/1018] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:14 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1672 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:34:15.600254 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-732453bd-27d0-44f5-bbde-c69c855e8ef0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:15.600855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-732453bd-27d0-44f5-bbde-c69c855e8ef0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:15.609399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-732453bd-27d0-44f5-bbde-c69c855e8ef0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:15.609908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-732453bd-27d0-44f5-bbde-c69c855e8ef0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:15.610738 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-732453bd-27d0-44f5-bbde-c69c855e8ef0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:15.611239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-732453bd-27d0-44f5-bbde-c69c855e8ef0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:15.739407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c21ef16d-2bbe-471f-897e-fc40ef120f7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:15.740117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c21ef16d-2bbe-471f-897e-fc40ef120f7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:15.748687 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c21ef16d-2bbe-471f-897e-fc40ef120f7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:15.749176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c21ef16d-2bbe-471f-897e-fc40ef120f7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:15.749993 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c21ef16d-2bbe-471f-897e-fc40ef120f7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:15.750475 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c21ef16d-2bbe-471f-897e-fc40ef120f7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:15.821401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-732453bd-27d0-44f5-bbde-c69c855e8ef0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:15.830318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-732453bd-27d0-44f5-bbde-c69c855e8ef0 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1572 microversion: 2.1 time: 0.234199 Feb 17 03:34:15.830927 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 486/1019] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:15 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1572 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:15.966041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c21ef16d-2bbe-471f-897e-fc40ef120f7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:15.974751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c21ef16d-2bbe-471f-897e-fc40ef120f7a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1672 microversion: 2.1 time: 0.239300 Feb 17 03:34:15.975342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 534/1020] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:15 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1672 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:34:16.848934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8cdf8dc7-2c6a-4161-87ef-af8d4f1b1770 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:16.849600 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8cdf8dc7-2c6a-4161-87ef-af8d4f1b1770 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:16.858248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8cdf8dc7-2c6a-4161-87ef-af8d4f1b1770 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:16.858750 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8cdf8dc7-2c6a-4161-87ef-af8d4f1b1770 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:16.859608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8cdf8dc7-2c6a-4161-87ef-af8d4f1b1770 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:16.860098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8cdf8dc7-2c6a-4161-87ef-af8d4f1b1770 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:16.993922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-56e2b3e9-4b6f-4a6f-bb70-602c99d79fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:16.994612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-56e2b3e9-4b6f-4a6f-bb70-602c99d79fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:17.002681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-56e2b3e9-4b6f-4a6f-bb70-602c99d79fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:17.003451 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-56e2b3e9-4b6f-4a6f-bb70-602c99d79fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:17.004391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-56e2b3e9-4b6f-4a6f-bb70-602c99d79fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:17.004914 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-56e2b3e9-4b6f-4a6f-bb70-602c99d79fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:17.087037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8cdf8dc7-2c6a-4161-87ef-af8d4f1b1770 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:17.097068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8cdf8dc7-2c6a-4161-87ef-af8d4f1b1770 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1572 microversion: 2.1 time: 0.251841 Feb 17 03:34:17.097591 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 487/1021] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:16 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1572 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:17.220925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-56e2b3e9-4b6f-4a6f-bb70-602c99d79fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:17.237149 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-56e2b3e9-4b6f-4a6f-bb70-602c99d79fe1 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1672 microversion: 2.1 time: 0.247163 Feb 17 03:34:17.237799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 535/1022] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:16 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1672 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:18.115785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cd1c4518-72cb-4a39-b18b-732ea9c0acf3 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:18.116454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cd1c4518-72cb-4a39-b18b-732ea9c0acf3 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:18.125575 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cd1c4518-72cb-4a39-b18b-732ea9c0acf3 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:18.126080 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cd1c4518-72cb-4a39-b18b-732ea9c0acf3 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:18.126908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cd1c4518-72cb-4a39-b18b-732ea9c0acf3 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:18.127398 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cd1c4518-72cb-4a39-b18b-732ea9c0acf3 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:18.255467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4560c11d-bea6-4b57-96af-9b5054fa5f56 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:18.256755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4560c11d-bea6-4b57-96af-9b5054fa5f56 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:18.267036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4560c11d-bea6-4b57-96af-9b5054fa5f56 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:18.267613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4560c11d-bea6-4b57-96af-9b5054fa5f56 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:18.268416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4560c11d-bea6-4b57-96af-9b5054fa5f56 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:18.268901 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4560c11d-bea6-4b57-96af-9b5054fa5f56 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:18.421022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4560c11d-bea6-4b57-96af-9b5054fa5f56 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa461b9b5c574c16b33c3da000b65f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540aff79a2694839aada97949939da9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:18.441142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4560c11d-bea6-4b57-96af-9b5054fa5f56 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 200 len: 1604 microversion: 2.1 time: 0.189487 Feb 17 03:34:18.441775 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 536/1023] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:18 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 1604 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:18.446540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-7a733453-5a21-4726-85f4-b0dcc062206c req-ae742cf0-3e68-4c5e-b3e9-ba200c840002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73390732-5d83-45e6-a650-228f06ea5210", "name": "network-vif-deleted", "tag": "493bd038-841b-4470-a3d9-cbec3c0afcd9"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:34:18.452989 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:34:18.452989 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:34:18.470860 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-7a733453-5a21-4726-85f4-b0dcc062206c req-ae742cf0-3e68-4c5e-b3e9-ba200c840002 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:18.471339 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-7a733453-5a21-4726-85f4-b0dcc062206c req-ae742cf0-3e68-4c5e-b3e9-ba200c840002 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:18.471937 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cd1c4518-72cb-4a39-b18b-732ea9c0acf3 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:18.487868 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cd1c4518-72cb-4a39-b18b-732ea9c0acf3 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1572 microversion: 2.1 time: 0.371537 Feb 17 03:34:18.493676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 488/1024] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:18 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1572 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:18.506814 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-7a733453-5a21-4726-85f4-b0dcc062206c req-ae742cf0-3e68-4c5e-b3e9-ba200c840002 service nova] Creating event network-vif-deleted:493bd038-841b-4470-a3d9-cbec3c0afcd9 for instance 73390732-5d83-45e6-a650-228f06ea5210 on hv-cinder-75996 Feb 17 03:34:18.513736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-7a733453-5a21-4726-85f4-b0dcc062206c req-ae742cf0-3e68-4c5e-b3e9-ba200c840002 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070107 Feb 17 03:34:18.514894 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 537/1025] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:34:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:34:18.864585 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-1bd584b8-f56d-456f-93e3-ac0e3e45bf04 req-23867e5b-514a-48d6-bb2e-1ea856095f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053ba632-5ab2-451f-96b5-adff294a7cb7", "name": "network-vif-unplugged", "status": "completed", "tag": "ee2e0f68-7311-4134-9186-6f27cbf5411a"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:34:18.866290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:34:18.866290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:34:18.875546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-1bd584b8-f56d-456f-93e3-ac0e3e45bf04 req-23867e5b-514a-48d6-bb2e-1ea856095f49 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:18.876058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-1bd584b8-f56d-456f-93e3-ac0e3e45bf04 req-23867e5b-514a-48d6-bb2e-1ea856095f49 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:18.894135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.compute.server_external_events [req-1bd584b8-f56d-456f-93e3-ac0e3e45bf04 req-23867e5b-514a-48d6-bb2e-1ea856095f49 service nova] Unable to find a host for instance 053ba632-5ab2-451f-96b5-adff294a7cb7. Dropping event network-vif-unplugged {{(pid=98184) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 17 03:34:18.895073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-1bd584b8-f56d-456f-93e3-ac0e3e45bf04 req-23867e5b-514a-48d6-bb2e-1ea856095f49 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034832 Feb 17 03:34:18.895747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 489/1026] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:34:18 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 17 03:34:19.460473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1144e101-fbf9-43f1-b4d1-928df2a0e568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:19.461230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1144e101-fbf9-43f1-b4d1-928df2a0e568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:19.469157 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1144e101-fbf9-43f1-b4d1-928df2a0e568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:19.469659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1144e101-fbf9-43f1-b4d1-928df2a0e568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:19.470471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1144e101-fbf9-43f1-b4d1-928df2a0e568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:19.470953 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1144e101-fbf9-43f1-b4d1-928df2a0e568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:19.506759 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-02331866-7c58-41aa-99e2-776f05ac8405 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:19.507696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-02331866-7c58-41aa-99e2-776f05ac8405 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:19.516058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02331866-7c58-41aa-99e2-776f05ac8405 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:19.516664 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02331866-7c58-41aa-99e2-776f05ac8405 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:19.517623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02331866-7c58-41aa-99e2-776f05ac8405 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:19.518531 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-02331866-7c58-41aa-99e2-776f05ac8405 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:19.524999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-1144e101-fbf9-43f1-b4d1-928df2a0e568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] HTTP exception thrown: Instance 73390732-5d83-45e6-a650-228f06ea5210 could not be found. Feb 17 03:34:19.525686 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1144e101-fbf9-43f1-b4d1-928df2a0e568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Returning 404 to user: Instance 73390732-5d83-45e6-a650-228f06ea5210 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:34:19.526571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1144e101-fbf9-43f1-b4d1-928df2a0e568 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 404 len: 111 microversion: 2.1 time: 0.070695 Feb 17 03:34:19.531037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 538/1027] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:19 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:34:19.535786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-89793f2c-4dec-46a4-91a2-6cdcf543daf4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '.version_select at 0x7f012e4ed7b8>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:19.553814 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-89793f2c-4dec-46a4-91a2-6cdcf543daf4 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2144542529" status: 202 len: 0 microversion: 2.1 time: 0.021458 Feb 17 03:34:19.554654 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 539/1028] 10.222.0.46 () {58 vars in 1211 bytes} [Wed Feb 17 03:34:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2144542529 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:34:19.745590 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-02331866-7c58-41aa-99e2-776f05ac8405 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:19.760001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-02331866-7c58-41aa-99e2-776f05ac8405 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1513 microversion: 2.1 time: 0.257364 Feb 17 03:34:19.760868 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 490/1029] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:19 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:19.779816 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fd6bd087-80f3-412f-b4e6-58ac84d25e81 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:34:19.780712 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fd6bd087-80f3-412f-b4e6-58ac84d25e81 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:19.789248 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd6bd087-80f3-412f-b4e6-58ac84d25e81 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:19.789833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd6bd087-80f3-412f-b4e6-58ac84d25e81 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:19.790748 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd6bd087-80f3-412f-b4e6-58ac84d25e81 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:19.791372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fd6bd087-80f3-412f-b4e6-58ac84d25e81 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:19.951461 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fd6bd087-80f3-412f-b4e6-58ac84d25e81 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "POST /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7/action" status: 202 len: 0 microversion: 2.1 time: 0.177014 Feb 17 03:34:19.952331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 540/1030] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:34:19 2021] POST /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:34:19.960604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cc2bcf79-60c1-4ab6-8979-226ef3046db7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:19.961278 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cc2bcf79-60c1-4ab6-8979-226ef3046db7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:19.969087 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc2bcf79-60c1-4ab6-8979-226ef3046db7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:19.969588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc2bcf79-60c1-4ab6-8979-226ef3046db7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:19.970471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc2bcf79-60c1-4ab6-8979-226ef3046db7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:19.970892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc2bcf79-60c1-4ab6-8979-226ef3046db7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:20.469131 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cc2bcf79-60c1-4ab6-8979-226ef3046db7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:20.480451 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cc2bcf79-60c1-4ab6-8979-226ef3046db7 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1521 microversion: 2.1 time: 0.522597 Feb 17 03:34:20.481657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 491/1031] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:19 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:21.499218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f5ebd0fd-9c95-4286-837c-a685091cae7d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:21.500005 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f5ebd0fd-9c95-4286-837c-a685091cae7d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:21.508377 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f5ebd0fd-9c95-4286-837c-a685091cae7d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:21.508893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f5ebd0fd-9c95-4286-837c-a685091cae7d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:21.509832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f5ebd0fd-9c95-4286-837c-a685091cae7d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:21.510326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f5ebd0fd-9c95-4286-837c-a685091cae7d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:21.848126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f5ebd0fd-9c95-4286-837c-a685091cae7d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:21.858499 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f5ebd0fd-9c95-4286-837c-a685091cae7d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1523 microversion: 2.1 time: 0.364000 Feb 17 03:34:21.859343 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 541/1032] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:21 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:22.878250 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f682c9f6-2946-4331-95b7-cf25000422ac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:22.878829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f682c9f6-2946-4331-95b7-cf25000422ac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:22.886657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f682c9f6-2946-4331-95b7-cf25000422ac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:22.887332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f682c9f6-2946-4331-95b7-cf25000422ac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:22.888564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f682c9f6-2946-4331-95b7-cf25000422ac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:22.888698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f682c9f6-2946-4331-95b7-cf25000422ac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:23.101720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f682c9f6-2946-4331-95b7-cf25000422ac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:23.111172 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f682c9f6-2946-4331-95b7-cf25000422ac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1523 microversion: 2.1 time: 0.237903 Feb 17 03:34:23.111801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 492/1033] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:22 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:24.129370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-71830b2d-7855-4f3a-8105-d6b1b5040bae tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:24.129964 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-71830b2d-7855-4f3a-8105-d6b1b5040bae tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:24.137855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71830b2d-7855-4f3a-8105-d6b1b5040bae tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:24.138353 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71830b2d-7855-4f3a-8105-d6b1b5040bae tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:24.139169 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71830b2d-7855-4f3a-8105-d6b1b5040bae tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:24.139678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-71830b2d-7855-4f3a-8105-d6b1b5040bae tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:24.353597 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-71830b2d-7855-4f3a-8105-d6b1b5040bae tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:24.362936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-71830b2d-7855-4f3a-8105-d6b1b5040bae tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1579 microversion: 2.1 time: 0.237673 Feb 17 03:34:24.363547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 542/1034] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:24 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1579 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:24.657223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a495b201-f643-4a90-ba26-dae3fb77884a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:24.657763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a495b201-f643-4a90-ba26-dae3fb77884a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:24.665636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a495b201-f643-4a90-ba26-dae3fb77884a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:24.666136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a495b201-f643-4a90-ba26-dae3fb77884a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:24.666947 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a495b201-f643-4a90-ba26-dae3fb77884a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:24.667428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a495b201-f643-4a90-ba26-dae3fb77884a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:24.722492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-a495b201-f643-4a90-ba26-dae3fb77884a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] HTTP exception thrown: Instance 73390732-5d83-45e6-a650-228f06ea5210 could not be found. Feb 17 03:34:24.723131 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a495b201-f643-4a90-ba26-dae3fb77884a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Returning 404 to user: Instance 73390732-5d83-45e6-a650-228f06ea5210 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:34:24.724042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a495b201-f643-4a90-ba26-dae3fb77884a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "DELETE /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 404 len: 111 microversion: 2.1 time: 0.070841 Feb 17 03:34:24.724623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 493/1035] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:34:24 2021] DELETE /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:34:24.733294 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d9b5a0ae-17ec-40e0-b95c-4a71870eb314 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:24.734004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d9b5a0ae-17ec-40e0-b95c-4a71870eb314 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 73390732-5d83-45e6-a650-228f06ea5210] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:24.741776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d9b5a0ae-17ec-40e0-b95c-4a71870eb314 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:24.742271 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d9b5a0ae-17ec-40e0-b95c-4a71870eb314 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:24.743082 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d9b5a0ae-17ec-40e0-b95c-4a71870eb314 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:24.743584 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d9b5a0ae-17ec-40e0-b95c-4a71870eb314 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:24.795681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-d9b5a0ae-17ec-40e0-b95c-4a71870eb314 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] HTTP exception thrown: Instance 73390732-5d83-45e6-a650-228f06ea5210 could not be found. Feb 17 03:34:24.796319 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d9b5a0ae-17ec-40e0-b95c-4a71870eb314 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Returning 404 to user: Instance 73390732-5d83-45e6-a650-228f06ea5210 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:34:24.797176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d9b5a0ae-17ec-40e0-b95c-4a71870eb314 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210" status: 404 len: 111 microversion: 2.1 time: 0.067915 Feb 17 03:34:24.797785 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 543/1036] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:24 2021] GET /compute/v2.1/servers/73390732-5d83-45e6-a650-228f06ea5210 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:34:25.380735 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3500e972-4b44-4421-a966-8eefed44bbec tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:25.381401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3500e972-4b44-4421-a966-8eefed44bbec tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:25.389680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3500e972-4b44-4421-a966-8eefed44bbec tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:25.390186 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3500e972-4b44-4421-a966-8eefed44bbec tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:25.391010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3500e972-4b44-4421-a966-8eefed44bbec tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:25.391498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3500e972-4b44-4421-a966-8eefed44bbec tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:25.597208 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3500e972-4b44-4421-a966-8eefed44bbec tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:25.606226 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3500e972-4b44-4421-a966-8eefed44bbec tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1579 microversion: 2.1 time: 0.229568 Feb 17 03:34:25.606819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 494/1037] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:25 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1579 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:26.053512 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2daa4a12-3263-4d1b-84c5-033c97f11b3a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:26.054011 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2daa4a12-3263-4d1b-84c5-033c97f11b3a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:26.062513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2daa4a12-3263-4d1b-84c5-033c97f11b3a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:26.063012 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2daa4a12-3263-4d1b-84c5-033c97f11b3a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:26.063916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2daa4a12-3263-4d1b-84c5-033c97f11b3a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:26.064407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2daa4a12-3263-4d1b-84c5-033c97f11b3a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:26.120058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-2daa4a12-3263-4d1b-84c5-033c97f11b3a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] HTTP exception thrown: Instance 415389d3-caaf-4b28-9090-426e4fe11633 could not be found. Feb 17 03:34:26.120707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2daa4a12-3263-4d1b-84c5-033c97f11b3a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Returning 404 to user: Instance 415389d3-caaf-4b28-9090-426e4fe11633 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:34:26.121577 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2daa4a12-3263-4d1b-84c5-033c97f11b3a tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "DELETE /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 404 len: 111 microversion: 2.1 time: 0.072416 Feb 17 03:34:26.122166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 544/1038] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:34:26 2021] DELETE /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:34:26.130612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1a7ccce7-5ead-491e-90ec-d34411c8b942 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:26.131275 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1a7ccce7-5ead-491e-90ec-d34411c8b942 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] [instance: 415389d3-caaf-4b28-9090-426e4fe11633] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:26.139170 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a7ccce7-5ead-491e-90ec-d34411c8b942 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:26.139695 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a7ccce7-5ead-491e-90ec-d34411c8b942 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:26.140521 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a7ccce7-5ead-491e-90ec-d34411c8b942 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:26.141009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a7ccce7-5ead-491e-90ec-d34411c8b942 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:26.193762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-1a7ccce7-5ead-491e-90ec-d34411c8b942 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] HTTP exception thrown: Instance 415389d3-caaf-4b28-9090-426e4fe11633 could not be found. Feb 17 03:34:26.194415 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1a7ccce7-5ead-491e-90ec-d34411c8b942 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] Returning 404 to user: Instance 415389d3-caaf-4b28-9090-426e4fe11633 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:34:26.195302 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1a7ccce7-5ead-491e-90ec-d34411c8b942 tempest-AttachVolumeTestJSON-1091520515 tempest-AttachVolumeTestJSON-1091520515-project] 10.222.0.46 "GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633" status: 404 len: 111 microversion: 2.1 time: 0.068718 Feb 17 03:34:26.196040 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 495/1039] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:26 2021] GET /compute/v2.1/servers/415389d3-caaf-4b28-9090-426e4fe11633 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:34:26.624939 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2ff5830c-5c09-46ec-9df8-7762dd019d51 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:26.625655 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2ff5830c-5c09-46ec-9df8-7762dd019d51 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:26.633528 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2ff5830c-5c09-46ec-9df8-7762dd019d51 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:26.634039 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2ff5830c-5c09-46ec-9df8-7762dd019d51 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:26.634867 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2ff5830c-5c09-46ec-9df8-7762dd019d51 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:26.636027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2ff5830c-5c09-46ec-9df8-7762dd019d51 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:26.849601 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2ff5830c-5c09-46ec-9df8-7762dd019d51 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:26.859286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2ff5830c-5c09-46ec-9df8-7762dd019d51 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1579 microversion: 2.1 time: 0.238360 Feb 17 03:34:26.859958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 545/1040] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:26 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1579 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:27.878034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-770f93b0-c41b-4369-9c30-c5a02202cf3d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:27.878699 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-770f93b0-c41b-4369-9c30-c5a02202cf3d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:27.886985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-770f93b0-c41b-4369-9c30-c5a02202cf3d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:27.887479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-770f93b0-c41b-4369-9c30-c5a02202cf3d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:27.888346 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-770f93b0-c41b-4369-9c30-c5a02202cf3d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:27.888827 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-770f93b0-c41b-4369-9c30-c5a02202cf3d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:28.100572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-770f93b0-c41b-4369-9c30-c5a02202cf3d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:28.109803 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-770f93b0-c41b-4369-9c30-c5a02202cf3d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1579 microversion: 2.1 time: 0.235700 Feb 17 03:34:28.110399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 496/1041] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:27 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1579 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:29.128555 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3f215131-4932-460e-a808-3935f22e111c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:29.129314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3f215131-4932-460e-a808-3935f22e111c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:29.137761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3f215131-4932-460e-a808-3935f22e111c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:29.138260 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3f215131-4932-460e-a808-3935f22e111c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:29.139081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3f215131-4932-460e-a808-3935f22e111c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:29.139578 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3f215131-4932-460e-a808-3935f22e111c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:29.354944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3f215131-4932-460e-a808-3935f22e111c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:29.364078 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3f215131-4932-460e-a808-3935f22e111c tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1579 microversion: 2.1 time: 0.239559 Feb 17 03:34:29.364684 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 546/1042] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:29 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1579 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:30.382678 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-df4ae2a6-76c4-471e-a0b1-9c3f4a53eb24 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:30.383787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-df4ae2a6-76c4-471e-a0b1-9c3f4a53eb24 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:30.391902 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df4ae2a6-76c4-471e-a0b1-9c3f4a53eb24 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:30.392395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df4ae2a6-76c4-471e-a0b1-9c3f4a53eb24 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:30.393298 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df4ae2a6-76c4-471e-a0b1-9c3f4a53eb24 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:30.393929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-df4ae2a6-76c4-471e-a0b1-9c3f4a53eb24 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:30.624936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-df4ae2a6-76c4-471e-a0b1-9c3f4a53eb24 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:30.638528 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-df4ae2a6-76c4-471e-a0b1-9c3f4a53eb24 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1579 microversion: 2.1 time: 0.260007 Feb 17 03:34:30.639788 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 497/1043] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:30 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1579 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:31.505925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-7eafc6f6-ce48-456b-84ef-bd1f01a1ffb1 req-e98205ee-9001-4124-8802-13dda6f532eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053ba632-5ab2-451f-96b5-adff294a7cb7", "name": "network-vif-plugged", "status": "completed", "tag": "ee2e0f68-7311-4134-9186-6f27cbf5411a"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:34:31.512055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:34:31.512055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:34:31.524564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-7eafc6f6-ce48-456b-84ef-bd1f01a1ffb1 req-e98205ee-9001-4124-8802-13dda6f532eb service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:31.525474 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-7eafc6f6-ce48-456b-84ef-bd1f01a1ffb1 req-e98205ee-9001-4124-8802-13dda6f532eb service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:31.549619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-7eafc6f6-ce48-456b-84ef-bd1f01a1ffb1 req-e98205ee-9001-4124-8802-13dda6f532eb service nova] Creating event network-vif-plugged:ee2e0f68-7311-4134-9186-6f27cbf5411a for instance 053ba632-5ab2-451f-96b5-adff294a7cb7 on hv-cinder-75996 Feb 17 03:34:31.555604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-7eafc6f6-ce48-456b-84ef-bd1f01a1ffb1 req-e98205ee-9001-4124-8802-13dda6f532eb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053503 Feb 17 03:34:31.558241 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 547/1044] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:34:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:34:31.657549 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2d0354f1-48c5-473a-b368-b6fd7825ad85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:31.658472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2d0354f1-48c5-473a-b368-b6fd7825ad85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:31.666920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d0354f1-48c5-473a-b368-b6fd7825ad85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:31.667549 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d0354f1-48c5-473a-b368-b6fd7825ad85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:31.668384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d0354f1-48c5-473a-b368-b6fd7825ad85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:31.668873 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2d0354f1-48c5-473a-b368-b6fd7825ad85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:31.982769 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2d0354f1-48c5-473a-b368-b6fd7825ad85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:31.996089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2d0354f1-48c5-473a-b368-b6fd7825ad85 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1579 microversion: 2.1 time: 0.342736 Feb 17 03:34:31.996906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 498/1045] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:31 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1579 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:33.015809 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9eb1c356-2337-467a-a918-b95cc9da8a27 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:33.016604 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9eb1c356-2337-467a-a918-b95cc9da8a27 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:33.024817 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9eb1c356-2337-467a-a918-b95cc9da8a27 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:33.025327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9eb1c356-2337-467a-a918-b95cc9da8a27 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:33.026201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9eb1c356-2337-467a-a918-b95cc9da8a27 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:33.026806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9eb1c356-2337-467a-a918-b95cc9da8a27 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:33.757383 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9eb1c356-2337-467a-a918-b95cc9da8a27 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:33.767138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9eb1c356-2337-467a-a918-b95cc9da8a27 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1579 microversion: 2.1 time: 0.756274 Feb 17 03:34:33.778214 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 548/1046] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:33 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1579 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:34.785809 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-661382d7-8a5e-42aa-80f6-127aa899b2e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:34.786479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-661382d7-8a5e-42aa-80f6-127aa899b2e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:34.794246 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-661382d7-8a5e-42aa-80f6-127aa899b2e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:34.794736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-661382d7-8a5e-42aa-80f6-127aa899b2e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:34.795586 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-661382d7-8a5e-42aa-80f6-127aa899b2e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:34.796079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-661382d7-8a5e-42aa-80f6-127aa899b2e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:35.009560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-661382d7-8a5e-42aa-80f6-127aa899b2e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:35.019015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-661382d7-8a5e-42aa-80f6-127aa899b2e2 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1566 microversion: 2.1 time: 0.237431 Feb 17 03:34:35.019625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 499/1047] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:34 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1566 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:42.004691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7a8fce02-8610-4cbf-8f6d-71a757b95e28 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:42.005238 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7a8fce02-8610-4cbf-8f6d-71a757b95e28 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:42.013172 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7a8fce02-8610-4cbf-8f6d-71a757b95e28 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:42.013674 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7a8fce02-8610-4cbf-8f6d-71a757b95e28 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:42.014497 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7a8fce02-8610-4cbf-8f6d-71a757b95e28 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:42.014985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7a8fce02-8610-4cbf-8f6d-71a757b95e28 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:42.079599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7a8fce02-8610-4cbf-8f6d-71a757b95e28 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Going to try to terminate instance {{(pid=98183) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:34:42.199044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7a8fce02-8610-4cbf-8f6d-71a757b95e28 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 204 len: 0 microversion: 2.20 time: 0.197059 Feb 17 03:34:42.199044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 549/1048] 10.222.0.46 () {60 vars in 1270 bytes} [Wed Feb 17 03:34:41 2021] DELETE /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 03:34:42.209150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-94654f7c-8997-46c1-be1a-11f243577a1a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:42.209150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-94654f7c-8997-46c1-be1a-11f243577a1a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:42.220015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-94654f7c-8997-46c1-be1a-11f243577a1a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:42.220615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-94654f7c-8997-46c1-be1a-11f243577a1a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:42.221560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-94654f7c-8997-46c1-be1a-11f243577a1a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:42.222117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-94654f7c-8997-46c1-be1a-11f243577a1a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:42.445393 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-94654f7c-8997-46c1-be1a-11f243577a1a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:42.455315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-94654f7c-8997-46c1-be1a-11f243577a1a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:42.456906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-94654f7c-8997-46c1-be1a-11f243577a1a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:42.458081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-94654f7c-8997-46c1-be1a-11f243577a1a tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1724 microversion: 2.20 time: 0.254590 Feb 17 03:34:42.458665 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 500/1049] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:42 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:43.479372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2b8c7a6b-14b6-482b-b993-83191739e39e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:43.480166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2b8c7a6b-14b6-482b-b993-83191739e39e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:43.487933 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2b8c7a6b-14b6-482b-b993-83191739e39e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:43.488435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2b8c7a6b-14b6-482b-b993-83191739e39e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:43.489257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2b8c7a6b-14b6-482b-b993-83191739e39e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:43.489743 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2b8c7a6b-14b6-482b-b993-83191739e39e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:43.715069 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2b8c7a6b-14b6-482b-b993-83191739e39e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:43.724818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2b8c7a6b-14b6-482b-b993-83191739e39e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:43.727128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2b8c7a6b-14b6-482b-b993-83191739e39e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:43.728802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2b8c7a6b-14b6-482b-b993-83191739e39e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1724 microversion: 2.20 time: 0.254205 Feb 17 03:34:43.729580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 550/1050] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:43 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:44.667203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-c8603567-ffa2-4e35-b23e-9a26e86b28ab req-1780519f-a5b5-4823-8def-da4743d246c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f420e97-ea65-416f-bcb1-3912244b4f06", "name": "network-vif-unplugged", "status": "completed", "tag": "ec0e37c1-8234-4d0f-97f8-aeb6924765b5"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:34:44.669332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:34:44.669332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:34:44.678206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-c8603567-ffa2-4e35-b23e-9a26e86b28ab req-1780519f-a5b5-4823-8def-da4743d246c0 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:44.678717 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-c8603567-ffa2-4e35-b23e-9a26e86b28ab req-1780519f-a5b5-4823-8def-da4743d246c0 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:44.696515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-c8603567-ffa2-4e35-b23e-9a26e86b28ab req-1780519f-a5b5-4823-8def-da4743d246c0 service nova] Creating event network-vif-unplugged:ec0e37c1-8234-4d0f-97f8-aeb6924765b5 for instance 4f420e97-ea65-416f-bcb1-3912244b4f06 on hv-cinder-75996 Feb 17 03:34:44.702246 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-c8603567-ffa2-4e35-b23e-9a26e86b28ab req-1780519f-a5b5-4823-8def-da4743d246c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040576 Feb 17 03:34:44.703099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 501/1051] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:34:44 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:34:44.749059 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a5c86d74-ddb4-4a98-96cc-ed0be14ccb8c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:44.749973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a5c86d74-ddb4-4a98-96cc-ed0be14ccb8c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:44.757749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a5c86d74-ddb4-4a98-96cc-ed0be14ccb8c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:44.758194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a5c86d74-ddb4-4a98-96cc-ed0be14ccb8c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:44.759446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a5c86d74-ddb4-4a98-96cc-ed0be14ccb8c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:44.759446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a5c86d74-ddb4-4a98-96cc-ed0be14ccb8c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:45.105015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a5c86d74-ddb4-4a98-96cc-ed0be14ccb8c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:45.114279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a5c86d74-ddb4-4a98-96cc-ed0be14ccb8c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:45.118615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a5c86d74-ddb4-4a98-96cc-ed0be14ccb8c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:45.119948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a5c86d74-ddb4-4a98-96cc-ed0be14ccb8c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1724 microversion: 2.20 time: 0.375732 Feb 17 03:34:45.120588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 551/1052] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:44 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1724 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:46.139921 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-336a7574-9c2e-45e8-92bd-65e3d0539146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:46.140686 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-336a7574-9c2e-45e8-92bd-65e3d0539146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:46.149540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-336a7574-9c2e-45e8-92bd-65e3d0539146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:46.163309 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-336a7574-9c2e-45e8-92bd-65e3d0539146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:46.164388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-336a7574-9c2e-45e8-92bd-65e3d0539146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:46.164893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-336a7574-9c2e-45e8-92bd-65e3d0539146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:46.300055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-336a7574-9c2e-45e8-92bd-65e3d0539146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:46.310641 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-336a7574-9c2e-45e8-92bd-65e3d0539146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:46.312257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-336a7574-9c2e-45e8-92bd-65e3d0539146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:46.313458 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-336a7574-9c2e-45e8-92bd-65e3d0539146 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1656 microversion: 2.20 time: 0.178207 Feb 17 03:34:46.314055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 502/1053] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:46 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1656 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:46.835956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-8d21276e-0227-40b3-beb4-88718b4e6aa0 req-c09b6d5f-3067-4aae-991d-3d60fc2ce3ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f420e97-ea65-416f-bcb1-3912244b4f06", "name": "network-vif-deleted", "tag": "ec0e37c1-8234-4d0f-97f8-aeb6924765b5"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:34:46.839021 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:34:46.839021 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:34:46.861981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-8d21276e-0227-40b3-beb4-88718b4e6aa0 req-c09b6d5f-3067-4aae-991d-3d60fc2ce3ff service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:46.862590 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-8d21276e-0227-40b3-beb4-88718b4e6aa0 req-c09b6d5f-3067-4aae-991d-3d60fc2ce3ff service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:46.882544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-8d21276e-0227-40b3-beb4-88718b4e6aa0 req-c09b6d5f-3067-4aae-991d-3d60fc2ce3ff service nova] Creating event network-vif-deleted:ec0e37c1-8234-4d0f-97f8-aeb6924765b5 for instance 4f420e97-ea65-416f-bcb1-3912244b4f06 on hv-cinder-75996 Feb 17 03:34:46.889055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-8d21276e-0227-40b3-beb4-88718b4e6aa0 req-c09b6d5f-3067-4aae-991d-3d60fc2ce3ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058204 Feb 17 03:34:46.889722 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 552/1054] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:34:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:34:47.333863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:47.335170 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:47.344942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:47.345834 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:47.346888 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:47.347687 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:47.430152 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:47.432596 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:47.433142 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lazy-loading 'fault' on Instance uuid 4f420e97-ea65-416f-bcb1-3912244b4f06 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:34:47.499477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:47.508713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:47.510792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b5d48272f134d44a615b37af1bbbed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d8b1f2f62fe46bd86f2158ff4c88376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:47.511954 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fe074166-f837-4803-9faa-23da9f4ada3c tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 200 len: 1372 microversion: 2.20 time: 0.182695 Feb 17 03:34:47.519494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 503/1055] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:47 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:48.533668 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4ae7d150-faa7-43ea-9ee1-7846b1eb9df6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:48.535378 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4ae7d150-faa7-43ea-9ee1-7846b1eb9df6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:48.543806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ae7d150-faa7-43ea-9ee1-7846b1eb9df6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:48.544314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ae7d150-faa7-43ea-9ee1-7846b1eb9df6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:48.545332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ae7d150-faa7-43ea-9ee1-7846b1eb9df6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:48.545797 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4ae7d150-faa7-43ea-9ee1-7846b1eb9df6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:48.601454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-4ae7d150-faa7-43ea-9ee1-7846b1eb9df6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] HTTP exception thrown: Instance 4f420e97-ea65-416f-bcb1-3912244b4f06 could not be found. Feb 17 03:34:48.602294 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4ae7d150-faa7-43ea-9ee1-7846b1eb9df6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Returning 404 to user: Instance 4f420e97-ea65-416f-bcb1-3912244b4f06 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:34:48.603479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4ae7d150-faa7-43ea-9ee1-7846b1eb9df6 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 404 len: 111 microversion: 2.20 time: 0.074836 Feb 17 03:34:48.604300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 553/1056] 10.222.0.46 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:48 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:34:48.613144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6003c6c0-a13e-4642-8f36-af5bc1475436 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '.version_select at 0x7f012da509d8>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:48.631213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6003c6c0-a13e-4642-8f36-af5bc1475436 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045486363" status: 204 len: 0 microversion: 2.20 time: 0.022148 Feb 17 03:34:48.632040 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 504/1057] 10.222.0.46 () {60 vars in 1252 bytes} [Wed Feb 17 03:34:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045486363 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 03:34:51.165359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7793be06-65d0-4c41-b727-3762b9aa9a4e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:51.166477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7793be06-65d0-4c41-b727-3762b9aa9a4e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:51.174068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7793be06-65d0-4c41-b727-3762b9aa9a4e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:51.174564 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7793be06-65d0-4c41-b727-3762b9aa9a4e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:51.175427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7793be06-65d0-4c41-b727-3762b9aa9a4e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:51.176058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7793be06-65d0-4c41-b727-3762b9aa9a4e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:51.232664 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-7793be06-65d0-4c41-b727-3762b9aa9a4e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] HTTP exception thrown: Instance 4f420e97-ea65-416f-bcb1-3912244b4f06 could not be found. Feb 17 03:34:51.233341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7793be06-65d0-4c41-b727-3762b9aa9a4e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Returning 404 to user: Instance 4f420e97-ea65-416f-bcb1-3912244b4f06 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:34:51.234216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7793be06-65d0-4c41-b727-3762b9aa9a4e tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 404 len: 111 microversion: 2.1 time: 0.072908 Feb 17 03:34:51.234996 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 554/1058] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:34:51 2021] DELETE /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:34:51.243888 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7bd7ae05-5d91-4bda-99da-5049522197c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:51.244557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7bd7ae05-5d91-4bda-99da-5049522197c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: 4f420e97-ea65-416f-bcb1-3912244b4f06] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:51.253438 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bd7ae05-5d91-4bda-99da-5049522197c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:51.254292 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bd7ae05-5d91-4bda-99da-5049522197c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:51.254964 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bd7ae05-5d91-4bda-99da-5049522197c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:51.255461 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7bd7ae05-5d91-4bda-99da-5049522197c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:51.308845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-7bd7ae05-5d91-4bda-99da-5049522197c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] HTTP exception thrown: Instance 4f420e97-ea65-416f-bcb1-3912244b4f06 could not be found. Feb 17 03:34:51.309517 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7bd7ae05-5d91-4bda-99da-5049522197c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Returning 404 to user: Instance 4f420e97-ea65-416f-bcb1-3912244b4f06 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:34:51.310413 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7bd7ae05-5d91-4bda-99da-5049522197c3 tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06" status: 404 len: 111 microversion: 2.1 time: 0.070913 Feb 17 03:34:51.311027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 505/1059] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:51 2021] GET /compute/v2.1/servers/4f420e97-ea65-416f-bcb1-3912244b4f06 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:34:52.568234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-96ebdb6a-4d46-46b8-a2fa-b369008fd1cf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:52.568831 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-96ebdb6a-4d46-46b8-a2fa-b369008fd1cf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:52.577437 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-96ebdb6a-4d46-46b8-a2fa-b369008fd1cf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:52.577958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-96ebdb6a-4d46-46b8-a2fa-b369008fd1cf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:52.578756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-96ebdb6a-4d46-46b8-a2fa-b369008fd1cf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:52.579428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-96ebdb6a-4d46-46b8-a2fa-b369008fd1cf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:52.633666 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-96ebdb6a-4d46-46b8-a2fa-b369008fd1cf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] HTTP exception thrown: Instance a89d14a3-493e-413a-918e-fd2de544e689 could not be found. Feb 17 03:34:52.634335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-96ebdb6a-4d46-46b8-a2fa-b369008fd1cf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Returning 404 to user: Instance a89d14a3-493e-413a-918e-fd2de544e689 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:34:52.635821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-96ebdb6a-4d46-46b8-a2fa-b369008fd1cf tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 404 len: 111 microversion: 2.1 time: 0.071593 Feb 17 03:34:52.636588 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 555/1060] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:34:52 2021] DELETE /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:34:52.644874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f686da16-c622-452f-b02a-188f7fc865fa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:52.645538 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f686da16-c622-452f-b02a-188f7fc865fa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] [instance: a89d14a3-493e-413a-918e-fd2de544e689] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:52.653237 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f686da16-c622-452f-b02a-188f7fc865fa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:52.653736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f686da16-c622-452f-b02a-188f7fc865fa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:52.654556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f686da16-c622-452f-b02a-188f7fc865fa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:52.655044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f686da16-c622-452f-b02a-188f7fc865fa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:52.710467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-f686da16-c622-452f-b02a-188f7fc865fa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] HTTP exception thrown: Instance a89d14a3-493e-413a-918e-fd2de544e689 could not be found. Feb 17 03:34:52.711444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f686da16-c622-452f-b02a-188f7fc865fa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] Returning 404 to user: Instance a89d14a3-493e-413a-918e-fd2de544e689 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:34:52.712575 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f686da16-c622-452f-b02a-188f7fc865fa tempest-AttachVolumeShelveTestJSON-403759288 tempest-AttachVolumeShelveTestJSON-403759288-project] 10.222.0.46 "GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689" status: 404 len: 111 microversion: 2.1 time: 0.071601 Feb 17 03:34:52.713315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 506/1061] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:52 2021] GET /compute/v2.1/servers/a89d14a3-493e-413a-918e-fd2de544e689 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:35:01.381542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c00fcbb5-16dd-4d91-b0e5-f3c81c1416c0 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] Action: 'create', calling method: .version_select at 0x7f012e1057b8>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2094686102", "metadata": {"Type": "work"}}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:01.857777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c00fcbb5-16dd-4d91-b0e5-f3c81c1416c0 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.604504 Feb 17 03:35:01.858457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 556/1062] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Feb 17 03:35:01 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 606 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 17 03:35:01.870425 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e6de4dc9-0262-4370-be53-4b865db58c45 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] Calling method '.version_select at 0x7f012df5c400>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:01.972034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e6de4dc9-0262-4370-be53-4b865db58c45 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/61323915-189d-4ba8-862f-51a419182349" status: 200 len: 353 microversion: 2.1 time: 0.105414 Feb 17 03:35:01.972663 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 507/1063] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:35:01 2021] GET /compute/v2.1/os-volumes/61323915-189d-4ba8-862f-51a419182349 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:02.985768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f355095e-1419-49cf-9bfc-53cbb58bbcb2 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] Calling method '.version_select at 0x7f012efea950>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:03.086474 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f355095e-1419-49cf-9bfc-53cbb58bbcb2 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/61323915-189d-4ba8-862f-51a419182349" status: 200 len: 354 microversion: 2.1 time: 0.104545 Feb 17 03:35:03.087102 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 557/1064] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:35:02 2021] GET /compute/v2.1/os-volumes/61323915-189d-4ba8-862f-51a419182349 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:03.106242 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3cd12e44-78bd-40f9-91ec-84b798321b50 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] Calling method '.version_select at 0x7f012de03ea0>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:03.208218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3cd12e44-78bd-40f9-91ec-84b798321b50 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/61323915-189d-4ba8-862f-51a419182349" status: 200 len: 354 microversion: 2.1 time: 0.112231 Feb 17 03:35:03.208837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 508/1065] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:35:03 2021] GET /compute/v2.1/os-volumes/61323915-189d-4ba8-862f-51a419182349 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:03.231253 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-45e002bd-984d-4b68-912f-3d4598794713 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] Calling method '.version_select at 0x7f012e105ae8>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:03.331821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-45e002bd-984d-4b68-912f-3d4598794713 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/61323915-189d-4ba8-862f-51a419182349" status: 202 len: 0 microversion: 2.1 time: 0.105744 Feb 17 03:35:03.332638 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 558/1066] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Feb 17 03:35:03 2021] DELETE /compute/v2.1/os-volumes/61323915-189d-4ba8-862f-51a419182349 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:35:03.341487 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f5ea6b06-c1ce-4e66-862a-c8708897675d tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] Calling method '.version_select at 0x7f012dd38ae8>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:03.440876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f5ea6b06-c1ce-4e66-862a-c8708897675d tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/61323915-189d-4ba8-862f-51a419182349" status: 200 len: 353 microversion: 2.1 time: 0.103725 Feb 17 03:35:03.441492 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 509/1067] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:35:03 2021] GET /compute/v2.1/os-volumes/61323915-189d-4ba8-862f-51a419182349 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:04.454081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6c57a551-5c80-4ab2-a79a-59a039be9ec0 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] Calling method '.version_select at 0x7f012e105950>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:04.522694 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-6c57a551-5c80-4ab2-a79a-59a039be9ec0 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] HTTP exception thrown: Volume 61323915-189d-4ba8-862f-51a419182349 could not be found. Feb 17 03:35:04.523580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6c57a551-5c80-4ab2-a79a-59a039be9ec0 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] Returning 404 to user: Volume 61323915-189d-4ba8-862f-51a419182349 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:35:04.524466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6c57a551-5c80-4ab2-a79a-59a039be9ec0 tempest-VolumesGetTestJSON-1961558761 tempest-VolumesGetTestJSON-1961558761-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/61323915-189d-4ba8-862f-51a419182349" status: 404 len: 109 microversion: 2.1 time: 0.074610 Feb 17 03:35:04.525140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 559/1068] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Feb 17 03:35:04 2021] GET /compute/v2.1/os-volumes/61323915-189d-4ba8-862f-51a419182349 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:35:10.364859 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-be360ca6-1d83-4979-a192-640df73aec25 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:10.365488 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-be360ca6-1d83-4979-a192-640df73aec25 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:10.373396 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be360ca6-1d83-4979-a192-640df73aec25 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:10.373910 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be360ca6-1d83-4979-a192-640df73aec25 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:10.374743 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be360ca6-1d83-4979-a192-640df73aec25 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:10.375236 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be360ca6-1d83-4979-a192-640df73aec25 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:10.442335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-be360ca6-1d83-4979-a192-640df73aec25 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Going to try to terminate instance {{(pid=98184) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:35:10.554807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-be360ca6-1d83-4979-a192-640df73aec25 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "DELETE /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 204 len: 0 microversion: 2.1 time: 0.193606 Feb 17 03:35:10.555444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 510/1069] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:35:10 2021] DELETE /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:35:10.565144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f539fd41-6ddc-4eb3-be93-5846cf07460e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:10.565810 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f539fd41-6ddc-4eb3-be93-5846cf07460e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:10.573958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f539fd41-6ddc-4eb3-be93-5846cf07460e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:10.574461 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f539fd41-6ddc-4eb3-be93-5846cf07460e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:10.575279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f539fd41-6ddc-4eb3-be93-5846cf07460e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:10.575823 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f539fd41-6ddc-4eb3-be93-5846cf07460e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:10.787532 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f539fd41-6ddc-4eb3-be93-5846cf07460e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:10.797043 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f539fd41-6ddc-4eb3-be93-5846cf07460e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1586 microversion: 2.1 time: 0.236342 Feb 17 03:35:10.797637 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 560/1070] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:10 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1586 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:11.816509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2eb09f04-eef9-44a6-a15b-0f82e5214ae7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:11.817275 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2eb09f04-eef9-44a6-a15b-0f82e5214ae7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:11.825196 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2eb09f04-eef9-44a6-a15b-0f82e5214ae7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:11.825703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2eb09f04-eef9-44a6-a15b-0f82e5214ae7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:11.826536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2eb09f04-eef9-44a6-a15b-0f82e5214ae7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:11.827031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2eb09f04-eef9-44a6-a15b-0f82e5214ae7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:12.037495 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2eb09f04-eef9-44a6-a15b-0f82e5214ae7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:12.046825 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2eb09f04-eef9-44a6-a15b-0f82e5214ae7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1586 microversion: 2.1 time: 0.234874 Feb 17 03:35:12.047427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 511/1071] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:11 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1586 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:13.065728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-be1a1ee7-46c2-4656-8e32-2ecd45b6be05 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:13.066392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-be1a1ee7-46c2-4656-8e32-2ecd45b6be05 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:13.074235 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be1a1ee7-46c2-4656-8e32-2ecd45b6be05 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:13.074738 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be1a1ee7-46c2-4656-8e32-2ecd45b6be05 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:13.075575 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be1a1ee7-46c2-4656-8e32-2ecd45b6be05 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:13.076066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-be1a1ee7-46c2-4656-8e32-2ecd45b6be05 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:13.289595 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-be1a1ee7-46c2-4656-8e32-2ecd45b6be05 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:13.298409 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-be1a1ee7-46c2-4656-8e32-2ecd45b6be05 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1586 microversion: 2.1 time: 0.236666 Feb 17 03:35:13.299007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 561/1072] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:13 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1586 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:14.317416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a204944c-623e-4f59-97d8-623c019a817f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:14.318079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a204944c-623e-4f59-97d8-623c019a817f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:14.326762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a204944c-623e-4f59-97d8-623c019a817f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:14.327266 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a204944c-623e-4f59-97d8-623c019a817f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:14.328164 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a204944c-623e-4f59-97d8-623c019a817f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:14.328660 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a204944c-623e-4f59-97d8-623c019a817f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:14.538075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a204944c-623e-4f59-97d8-623c019a817f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:14.546800 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a204944c-623e-4f59-97d8-623c019a817f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1586 microversion: 2.1 time: 0.233517 Feb 17 03:35:14.547466 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 512/1073] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:14 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1586 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:15.565005 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-103ad8da-80bb-4fa6-b9ec-9407fe0bc145 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:15.565683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-103ad8da-80bb-4fa6-b9ec-9407fe0bc145 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:15.573760 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-103ad8da-80bb-4fa6-b9ec-9407fe0bc145 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:15.574203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-103ad8da-80bb-4fa6-b9ec-9407fe0bc145 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:15.575044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-103ad8da-80bb-4fa6-b9ec-9407fe0bc145 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:15.575555 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-103ad8da-80bb-4fa6-b9ec-9407fe0bc145 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:15.682876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-4d3ddf1f-7e78-4996-93b1-9445308bb8a2 req-06d6e54f-f7eb-45e8-a1bd-40e787cb4086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09664edd-5f9f-4b5e-b7b1-06857eff4d59", "name": "network-vif-unplugged", "status": "completed", "tag": "35520748-b121-42ff-b9ac-e966407e4668"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:15.684967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:15.684967 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:35:15.695039 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-4d3ddf1f-7e78-4996-93b1-9445308bb8a2 req-06d6e54f-f7eb-45e8-a1bd-40e787cb4086 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:15.695829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-4d3ddf1f-7e78-4996-93b1-9445308bb8a2 req-06d6e54f-f7eb-45e8-a1bd-40e787cb4086 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:15.717527 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-4d3ddf1f-7e78-4996-93b1-9445308bb8a2 req-06d6e54f-f7eb-45e8-a1bd-40e787cb4086 service nova] Creating event network-vif-unplugged:35520748-b121-42ff-b9ac-e966407e4668 for instance 09664edd-5f9f-4b5e-b7b1-06857eff4d59 on hv-cinder-75996 Feb 17 03:35:15.724021 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-4d3ddf1f-7e78-4996-93b1-9445308bb8a2 req-06d6e54f-f7eb-45e8-a1bd-40e787cb4086 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044783 Feb 17 03:35:15.725494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 513/1074] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:15 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:35:15.809267 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-103ad8da-80bb-4fa6-b9ec-9407fe0bc145 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:15.818041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-103ad8da-80bb-4fa6-b9ec-9407fe0bc145 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1586 microversion: 2.1 time: 0.257107 Feb 17 03:35:15.818640 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 562/1075] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:15 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1586 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:16.837201 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f300cfa6-44e2-408e-8b8a-53a50b6f2827 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:16.838336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f300cfa6-44e2-408e-8b8a-53a50b6f2827 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:16.846552 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f300cfa6-44e2-408e-8b8a-53a50b6f2827 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:16.847065 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f300cfa6-44e2-408e-8b8a-53a50b6f2827 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:16.847934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f300cfa6-44e2-408e-8b8a-53a50b6f2827 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:16.848646 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f300cfa6-44e2-408e-8b8a-53a50b6f2827 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:17.066571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f300cfa6-44e2-408e-8b8a-53a50b6f2827 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:17.076154 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f300cfa6-44e2-408e-8b8a-53a50b6f2827 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1586 microversion: 2.1 time: 0.243541 Feb 17 03:35:17.076755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 514/1076] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:16 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1586 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:17.847168 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-12bd9cae-7fd3-4910-948c-b73ba9d9e38b req-967b98ec-40be-41a1-9794-0e03e5f76284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09664edd-5f9f-4b5e-b7b1-06857eff4d59", "name": "network-vif-deleted", "tag": "35520748-b121-42ff-b9ac-e966407e4668"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:17.849683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:17.849683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:35:17.860223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-12bd9cae-7fd3-4910-948c-b73ba9d9e38b req-967b98ec-40be-41a1-9794-0e03e5f76284 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:17.861194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-12bd9cae-7fd3-4910-948c-b73ba9d9e38b req-967b98ec-40be-41a1-9794-0e03e5f76284 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:17.892120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-12bd9cae-7fd3-4910-948c-b73ba9d9e38b req-967b98ec-40be-41a1-9794-0e03e5f76284 service nova] Creating event network-vif-deleted:35520748-b121-42ff-b9ac-e966407e4668 for instance 09664edd-5f9f-4b5e-b7b1-06857eff4d59 on hv-cinder-75996 Feb 17 03:35:17.899312 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-12bd9cae-7fd3-4910-948c-b73ba9d9e38b req-967b98ec-40be-41a1-9794-0e03e5f76284 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056403 Feb 17 03:35:17.900897 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 563/1077] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:18.095777 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-39543df7-e684-4dcf-8bf4-7854b4563a8f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:18.096934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-39543df7-e684-4dcf-8bf4-7854b4563a8f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:18.105875 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-39543df7-e684-4dcf-8bf4-7854b4563a8f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:18.106681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-39543df7-e684-4dcf-8bf4-7854b4563a8f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:18.107831 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-39543df7-e684-4dcf-8bf4-7854b4563a8f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:18.108337 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-39543df7-e684-4dcf-8bf4-7854b4563a8f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:18.269951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-39543df7-e684-4dcf-8bf4-7854b4563a8f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:18.280189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-39543df7-e684-4dcf-8bf4-7854b4563a8f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 200 len: 1226 microversion: 2.1 time: 0.189319 Feb 17 03:35:18.281135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 515/1078] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:18 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 1226 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:19.299303 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1eb9f55f-0b5d-42d4-9357-3427fb055a0d tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:19.300136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1eb9f55f-0b5d-42d4-9357-3427fb055a0d tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:19.308299 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1eb9f55f-0b5d-42d4-9357-3427fb055a0d tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:19.308796 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1eb9f55f-0b5d-42d4-9357-3427fb055a0d tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:19.309615 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1eb9f55f-0b5d-42d4-9357-3427fb055a0d tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:19.310115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1eb9f55f-0b5d-42d4-9357-3427fb055a0d tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:19.363751 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-1eb9f55f-0b5d-42d4-9357-3427fb055a0d tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] HTTP exception thrown: Instance 09664edd-5f9f-4b5e-b7b1-06857eff4d59 could not be found. Feb 17 03:35:19.364418 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1eb9f55f-0b5d-42d4-9357-3427fb055a0d tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Returning 404 to user: Instance 09664edd-5f9f-4b5e-b7b1-06857eff4d59 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:35:19.365308 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1eb9f55f-0b5d-42d4-9357-3427fb055a0d tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 404 len: 111 microversion: 2.1 time: 0.070616 Feb 17 03:35:19.365923 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 564/1079] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:19 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:35:19.484821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-985156151", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1857685246", "security_groups": [{"name": "tempest-TestVolumeBootPattern-2001516187"}], "block_device_mapping_v2": [{"uuid": "d3cc0687-e522-4506-83bf-ff2cf2b0f548", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4e746511-e0b4-40cf-9f26-4fcf068fda47"}]}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:19.660007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] validate_networks() for [('4e746511-e0b4-40cf-9f26-4fcf068fda47', None, None, None)] {{(pid=98184) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:35:20.516599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Flavor limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:35:20.517130 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Image limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:35:20.517630 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Flavor pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:35:20.518091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Image pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:35:20.518577 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:35:20.528268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:20.528799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:20.529716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:20.530212 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:20.549481 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Getting quotas for project fce55aed27e14d6791193d35e5ac2137. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:35:20.554132 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Getting quotas for user a08274bcef1c4e73a39e60b3a11b09d1 and project fce55aed27e14d6791193d35e5ac2137. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:35:20.659612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Going to run 1 instances... {{(pid=98184) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:35:20.661997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3cc0687-e522-4506-83bf-ff2cf2b0f548',volume_size=None,volume_type=None)] {{(pid=98184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:35:20.839996 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-834feba4-b5cf-4101-acff-98f64ee5bdca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.358883 Feb 17 03:35:20.841223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 516/1080] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:35:19 2021] POST /compute/v2.1/servers => generated 413 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:35:20.856407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-22727526-7d0b-447d-8bc2-bb2fceef0526 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:20.858857 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-22727526-7d0b-447d-8bc2-bb2fceef0526 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:20.939178 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-22727526-7d0b-447d-8bc2-bb2fceef0526 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:20.947863 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-22727526-7d0b-447d-8bc2-bb2fceef0526 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1094 microversion: 2.1 time: 0.098638 Feb 17 03:35:20.948440 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 565/1081] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:20 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:21.966567 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b899ac08-c7dd-4a84-b53a-11d3c68ee456 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:21.967280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b899ac08-c7dd-4a84-b53a-11d3c68ee456 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:21.976010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b899ac08-c7dd-4a84-b53a-11d3c68ee456 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:21.976520 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b899ac08-c7dd-4a84-b53a-11d3c68ee456 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:21.977356 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b899ac08-c7dd-4a84-b53a-11d3c68ee456 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:21.978425 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b899ac08-c7dd-4a84-b53a-11d3c68ee456 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:22.289268 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b899ac08-c7dd-4a84-b53a-11d3c68ee456 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:22.302399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b899ac08-c7dd-4a84-b53a-11d3c68ee456 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1210 microversion: 2.1 time: 0.340264 Feb 17 03:35:22.303183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 517/1082] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:21 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1210 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:23.322148 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-89e71139-adf5-4b69-b841-bab71178ca27 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:23.322815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-89e71139-adf5-4b69-b841-bab71178ca27 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:23.341370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89e71139-adf5-4b69-b841-bab71178ca27 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:23.341874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89e71139-adf5-4b69-b841-bab71178ca27 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:23.342720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89e71139-adf5-4b69-b841-bab71178ca27 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:23.343203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-89e71139-adf5-4b69-b841-bab71178ca27 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:23.570999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-89e71139-adf5-4b69-b841-bab71178ca27 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:23.580098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-89e71139-adf5-4b69-b841-bab71178ca27 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.262400 Feb 17 03:35:23.580871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 566/1083] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:23 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:24.605587 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-773ea9e8-9741-4319-9f53-a4a447824c7a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:24.606920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-773ea9e8-9741-4319-9f53-a4a447824c7a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:24.617755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-773ea9e8-9741-4319-9f53-a4a447824c7a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:24.619218 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-773ea9e8-9741-4319-9f53-a4a447824c7a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:24.620280 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-773ea9e8-9741-4319-9f53-a4a447824c7a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:24.626245 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-773ea9e8-9741-4319-9f53-a4a447824c7a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:24.899500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-773ea9e8-9741-4319-9f53-a4a447824c7a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:24.910915 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-773ea9e8-9741-4319-9f53-a4a447824c7a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.312837 Feb 17 03:35:24.911898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 518/1084] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:24 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:25.026380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-b8a15384-123f-4558-8b81-aceb8e5b53d7 req-faa415a5-13ff-466f-8522-99a2341cdde3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee716fa-64a8-4f42-9f18-bf27ec384b48", "tag": "65586199-8d17-4dc4-95e3-587c045d051c"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:25.028861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:25.028861 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:35:25.046417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-b8a15384-123f-4558-8b81-aceb8e5b53d7 req-faa415a5-13ff-466f-8522-99a2341cdde3 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:25.047206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-b8a15384-123f-4558-8b81-aceb8e5b53d7 req-faa415a5-13ff-466f-8522-99a2341cdde3 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:25.069373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-b8a15384-123f-4558-8b81-aceb8e5b53d7 req-faa415a5-13ff-466f-8522-99a2341cdde3 service nova] Creating event network-changed:65586199-8d17-4dc4-95e3-587c045d051c for instance fee716fa-64a8-4f42-9f18-bf27ec384b48 on hv-cinder-75996 Feb 17 03:35:25.090683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-b8a15384-123f-4558-8b81-aceb8e5b53d7 req-faa415a5-13ff-466f-8522-99a2341cdde3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069317 Feb 17 03:35:25.091691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 567/1085] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:25.929935 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-91952e30-5cd7-49a7-81e6-1fc4d2723930 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:25.930596 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-91952e30-5cd7-49a7-81e6-1fc4d2723930 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:25.938460 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91952e30-5cd7-49a7-81e6-1fc4d2723930 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:25.938960 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91952e30-5cd7-49a7-81e6-1fc4d2723930 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:25.939818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91952e30-5cd7-49a7-81e6-1fc4d2723930 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:25.940300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-91952e30-5cd7-49a7-81e6-1fc4d2723930 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:26.161738 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-91952e30-5cd7-49a7-81e6-1fc4d2723930 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:26.170740 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-91952e30-5cd7-49a7-81e6-1fc4d2723930 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.244832 Feb 17 03:35:26.171331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 519/1086] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:25 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:27.189356 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-115aace1-03f2-479c-b07d-a0cc4044c209 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:27.190126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-115aace1-03f2-479c-b07d-a0cc4044c209 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:27.199123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-115aace1-03f2-479c-b07d-a0cc4044c209 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:27.199599 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-115aace1-03f2-479c-b07d-a0cc4044c209 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:27.200444 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-115aace1-03f2-479c-b07d-a0cc4044c209 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:27.200936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-115aace1-03f2-479c-b07d-a0cc4044c209 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:27.554987 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-115aace1-03f2-479c-b07d-a0cc4044c209 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:27.564757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-115aace1-03f2-479c-b07d-a0cc4044c209 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.379882 Feb 17 03:35:27.565613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 568/1087] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:27 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:28.582754 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ef737cbd-49cd-4d6e-a975-8c9c0467bebe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:28.583478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ef737cbd-49cd-4d6e-a975-8c9c0467bebe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:28.591972 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef737cbd-49cd-4d6e-a975-8c9c0467bebe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:28.592478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef737cbd-49cd-4d6e-a975-8c9c0467bebe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:28.593306 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef737cbd-49cd-4d6e-a975-8c9c0467bebe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:28.593805 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ef737cbd-49cd-4d6e-a975-8c9c0467bebe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:28.864337 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ef737cbd-49cd-4d6e-a975-8c9c0467bebe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:28.875976 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ef737cbd-49cd-4d6e-a975-8c9c0467bebe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.297317 Feb 17 03:35:28.876953 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 520/1088] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:28 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:29.893234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-14c69330-21fe-46ec-8c20-07dbe844b0d0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:29.893893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-14c69330-21fe-46ec-8c20-07dbe844b0d0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:29.902290 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14c69330-21fe-46ec-8c20-07dbe844b0d0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:29.902787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14c69330-21fe-46ec-8c20-07dbe844b0d0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:29.903633 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14c69330-21fe-46ec-8c20-07dbe844b0d0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:29.904122 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-14c69330-21fe-46ec-8c20-07dbe844b0d0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:30.122491 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-14c69330-21fe-46ec-8c20-07dbe844b0d0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:30.131576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-14c69330-21fe-46ec-8c20-07dbe844b0d0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.242254 Feb 17 03:35:30.132166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 569/1089] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:29 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:31.150046 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a95fc4f3-a07d-4257-9157-da32f8974552 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:31.150699 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a95fc4f3-a07d-4257-9157-da32f8974552 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:31.158536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a95fc4f3-a07d-4257-9157-da32f8974552 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:31.159034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a95fc4f3-a07d-4257-9157-da32f8974552 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:31.159880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a95fc4f3-a07d-4257-9157-da32f8974552 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:31.160366 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a95fc4f3-a07d-4257-9157-da32f8974552 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:31.473333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a95fc4f3-a07d-4257-9157-da32f8974552 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:31.487222 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a95fc4f3-a07d-4257-9157-da32f8974552 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.341083 Feb 17 03:35:31.496344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 521/1090] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:31 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:32.514198 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bd5d0c44-ca91-4017-8b28-873748146db7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:32.514849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bd5d0c44-ca91-4017-8b28-873748146db7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:32.522601 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bd5d0c44-ca91-4017-8b28-873748146db7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:32.523104 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bd5d0c44-ca91-4017-8b28-873748146db7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:32.523965 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bd5d0c44-ca91-4017-8b28-873748146db7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:32.524944 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bd5d0c44-ca91-4017-8b28-873748146db7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:32.742876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-bd5d0c44-ca91-4017-8b28-873748146db7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:32.752462 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bd5d0c44-ca91-4017-8b28-873748146db7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.242164 Feb 17 03:35:32.753193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 570/1091] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:32 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:33.771692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2e3e9c18-dfd1-4aa9-9cb3-4c0554473f31 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:33.772247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2e3e9c18-dfd1-4aa9-9cb3-4c0554473f31 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:33.780895 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2e3e9c18-dfd1-4aa9-9cb3-4c0554473f31 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:33.781452 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2e3e9c18-dfd1-4aa9-9cb3-4c0554473f31 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:33.782293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2e3e9c18-dfd1-4aa9-9cb3-4c0554473f31 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:33.782792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2e3e9c18-dfd1-4aa9-9cb3-4c0554473f31 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:33.999272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2e3e9c18-dfd1-4aa9-9cb3-4c0554473f31 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:34.009324 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2e3e9c18-dfd1-4aa9-9cb3-4c0554473f31 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.241587 Feb 17 03:35:34.010436 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 522/1092] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:33 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:35:35.027112 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f28089ec-7e4e-41bf-8c76-cc6a8b11bcc0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:35.027808 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f28089ec-7e4e-41bf-8c76-cc6a8b11bcc0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:35.035811 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f28089ec-7e4e-41bf-8c76-cc6a8b11bcc0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:35.036318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f28089ec-7e4e-41bf-8c76-cc6a8b11bcc0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:35.037151 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f28089ec-7e4e-41bf-8c76-cc6a8b11bcc0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:35.037627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f28089ec-7e4e-41bf-8c76-cc6a8b11bcc0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:35.277516 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f28089ec-7e4e-41bf-8c76-cc6a8b11bcc0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:35.286434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f28089ec-7e4e-41bf-8c76-cc6a8b11bcc0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.263303 Feb 17 03:35:35.287035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 571/1093] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:35 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:36.304481 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-20212819-ac00-44f9-8b58-c209ad7e3b37 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:36.305741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-20212819-ac00-44f9-8b58-c209ad7e3b37 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:36.313928 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-20212819-ac00-44f9-8b58-c209ad7e3b37 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:36.314433 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-20212819-ac00-44f9-8b58-c209ad7e3b37 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:36.315278 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-20212819-ac00-44f9-8b58-c209ad7e3b37 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:36.315800 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-20212819-ac00-44f9-8b58-c209ad7e3b37 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:37.066663 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-20212819-ac00-44f9-8b58-c209ad7e3b37 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:37.076726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-20212819-ac00-44f9-8b58-c209ad7e3b37 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.776172 Feb 17 03:35:37.077815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 523/1094] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:36 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:38.094741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8098ac92-d268-4e1e-a662-f6c7da28f23f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:38.095470 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8098ac92-d268-4e1e-a662-f6c7da28f23f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:38.104193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8098ac92-d268-4e1e-a662-f6c7da28f23f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:38.104804 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8098ac92-d268-4e1e-a662-f6c7da28f23f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:38.105735 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8098ac92-d268-4e1e-a662-f6c7da28f23f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:38.106299 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8098ac92-d268-4e1e-a662-f6c7da28f23f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:38.459419 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8098ac92-d268-4e1e-a662-f6c7da28f23f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:38.469623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8098ac92-d268-4e1e-a662-f6c7da28f23f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.378967 Feb 17 03:35:38.470333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 572/1095] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:38 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:38.980351 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-89ef400a-e81b-404a-8a8e-f5e14e2a6d40 req-dd39f11e-3767-447a-8a43-4b7f669ba713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee716fa-64a8-4f42-9f18-bf27ec384b48", "name": "network-vif-plugged", "status": "completed", "tag": "65586199-8d17-4dc4-95e3-587c045d051c"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:38.983786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:38.983786 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:35:38.996350 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-89ef400a-e81b-404a-8a8e-f5e14e2a6d40 req-dd39f11e-3767-447a-8a43-4b7f669ba713 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:38.996968 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-89ef400a-e81b-404a-8a8e-f5e14e2a6d40 req-dd39f11e-3767-447a-8a43-4b7f669ba713 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:39.015649 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-89ef400a-e81b-404a-8a8e-f5e14e2a6d40 req-dd39f11e-3767-447a-8a43-4b7f669ba713 service nova] Creating event network-vif-plugged:65586199-8d17-4dc4-95e3-587c045d051c for instance fee716fa-64a8-4f42-9f18-bf27ec384b48 on hv-cinder-75996 Feb 17 03:35:39.021005 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-89ef400a-e81b-404a-8a8e-f5e14e2a6d40 req-dd39f11e-3767-447a-8a43-4b7f669ba713 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045406 Feb 17 03:35:39.021956 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 524/1096] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:39.490628 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4218600d-bc65-43a4-8364-c64771fcaf3b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:39.491313 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4218600d-bc65-43a4-8364-c64771fcaf3b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:39.513367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4218600d-bc65-43a4-8364-c64771fcaf3b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:39.513876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4218600d-bc65-43a4-8364-c64771fcaf3b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:39.514731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4218600d-bc65-43a4-8364-c64771fcaf3b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:39.515220 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4218600d-bc65-43a4-8364-c64771fcaf3b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:40.128250 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4218600d-bc65-43a4-8364-c64771fcaf3b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:40.138647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4218600d-bc65-43a4-8364-c64771fcaf3b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1273 microversion: 2.1 time: 0.654213 Feb 17 03:35:40.139254 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 573/1097] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:39 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1273 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:41.157259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-05422995-3665-41a3-819a-7f47d7ef33cb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:41.158031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-05422995-3665-41a3-819a-7f47d7ef33cb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:41.169965 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-05422995-3665-41a3-819a-7f47d7ef33cb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:41.170560 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-05422995-3665-41a3-819a-7f47d7ef33cb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:41.175166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-05422995-3665-41a3-819a-7f47d7ef33cb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:41.175693 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-05422995-3665-41a3-819a-7f47d7ef33cb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:41.521787 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-05422995-3665-41a3-819a-7f47d7ef33cb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:41.554454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-05422995-3665-41a3-819a-7f47d7ef33cb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1460 microversion: 2.1 time: 0.401179 Feb 17 03:35:41.555122 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 525/1098] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:41 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1460 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:41.573095 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5131a3c1-e6de-473a-86a2-5f5280ded1bb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:41.574006 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5131a3c1-e6de-473a-86a2-5f5280ded1bb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:41.583941 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5131a3c1-e6de-473a-86a2-5f5280ded1bb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:41.584448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5131a3c1-e6de-473a-86a2-5f5280ded1bb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:41.585296 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5131a3c1-e6de-473a-86a2-5f5280ded1bb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:41.585757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5131a3c1-e6de-473a-86a2-5f5280ded1bb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:41.863153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-5131a3c1-e6de-473a-86a2-5f5280ded1bb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:41.875025 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5131a3c1-e6de-473a-86a2-5f5280ded1bb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1460 microversion: 2.1 time: 0.306321 Feb 17 03:35:41.876117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 574/1099] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:41 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1460 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:41.893264 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-50a8a474-37b6-47be-b5c5-172139d3fb7e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'create', calling method: .version_select at 0x7f012dc7b400>, body: {"pool": null} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:44.577756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-50a8a474-37b6-47be-b5c5-172139d3fb7e tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.688447 Feb 17 03:35:44.579546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 526/1100] 10.222.0.46 () {60 vars in 1160 bytes} [Wed Feb 17 03:35:41 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:35:44.591189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3762b2df-fd4c-4c16-affa-e3b697536cca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'action', calling method: .version_select at 0x7f012fcb3ae8>, body: {"addFloatingIp": {"address": "172.27.1.130"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:44.592735 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3762b2df-fd4c-4c16-affa-e3b697536cca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:44.610237 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3762b2df-fd4c-4c16-affa-e3b697536cca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:44.618057 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3762b2df-fd4c-4c16-affa-e3b697536cca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:44.619558 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3762b2df-fd4c-4c16-affa-e3b697536cca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:44.620795 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3762b2df-fd4c-4c16-affa-e3b697536cca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:44.722341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3762b2df-fd4c-4c16-affa-e3b697536cca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Acquired lock "refresh_cache-fee716fa-64a8-4f42-9f18-bf27ec384b48" {{(pid=98183) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:35:47.438174 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-3762b2df-fd4c-4c16-affa-e3b697536cca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Building network info cache for instance {{(pid=98183) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:35:47.485150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-f310ed03-6b88-4d02-a06c-007d4a8e700b req-e659d20e-6f92-4390-a9fa-57e4f07b62f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee716fa-64a8-4f42-9f18-bf27ec384b48", "tag": "65586199-8d17-4dc4-95e3-587c045d051c"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:47.487430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:47.487430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:35:47.558230 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f310ed03-6b88-4d02-a06c-007d4a8e700b req-e659d20e-6f92-4390-a9fa-57e4f07b62f2 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:47.577293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f310ed03-6b88-4d02-a06c-007d4a8e700b req-e659d20e-6f92-4390-a9fa-57e4f07b62f2 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:47.632617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-f310ed03-6b88-4d02-a06c-007d4a8e700b req-e659d20e-6f92-4390-a9fa-57e4f07b62f2 service nova] Creating event network-changed:65586199-8d17-4dc4-95e3-587c045d051c for instance fee716fa-64a8-4f42-9f18-bf27ec384b48 on hv-cinder-75996 Feb 17 03:35:47.638073 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-f310ed03-6b88-4d02-a06c-007d4a8e700b req-e659d20e-6f92-4390-a9fa-57e4f07b62f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163207 Feb 17 03:35:47.642098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 527/1101] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:48.656945 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-3762b2df-fd4c-4c16-affa-e3b697536cca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Updating instance_info_cache with network_info: [{"id": "65586199-8d17-4dc4-95e3-587c045d051c", "address": "fa:16:3e:a0:05:85", "network": {"id": "4e746511-e0b4-40cf-9f26-4fcf068fda47", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-563910191-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fce55aed27e14d6791193d35e5ac2137", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap65586199-8d", "ovs_interfaceid": "65586199-8d17-4dc4-95e3-587c045d051c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98183) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:35:48.680380 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3762b2df-fd4c-4c16-affa-e3b697536cca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Releasing lock "refresh_cache-fee716fa-64a8-4f42-9f18-bf27ec384b48" {{(pid=98183) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:35:48.690742 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3762b2df-fd4c-4c16-affa-e3b697536cca tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48/action" status: 202 len: 0 microversion: 2.1 time: 4.104588 Feb 17 03:35:48.695367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 575/1102] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:35:44 2021] POST /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48/action => generated 0 bytes in 4110 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 03:35:48.780521 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8877fafa-3b2f-41a2-86e9-d60200decb0a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '.version_select at 0x7f012dc7b7b8>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:49.426576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8877fafa-3b2f-41a2-86e9-d60200decb0a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:49.453101 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8877fafa-3b2f-41a2-86e9-d60200decb0a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:49.454113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8877fafa-3b2f-41a2-86e9-d60200decb0a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:49.455459 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8877fafa-3b2f-41a2-86e9-d60200decb0a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:49.457203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8877fafa-3b2f-41a2-86e9-d60200decb0a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:49.598780 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8877fafa-3b2f-41a2-86e9-d60200decb0a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Acquired lock "refresh_cache-053ba632-5ab2-451f-96b5-adff294a7cb7" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:35:52.172952 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-8877fafa-3b2f-41a2-86e9-d60200decb0a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Building network info cache for instance {{(pid=98184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:35:52.183546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-f2a881c9-1064-4127-85b6-f5c1a789d139 req-cc3318c0-d0ab-46a7-b0c1-24d1ff60aa6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053ba632-5ab2-451f-96b5-adff294a7cb7", "tag": "ee2e0f68-7311-4134-9186-6f27cbf5411a"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:52.185392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:52.185392 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:35:52.206334 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f2a881c9-1064-4127-85b6-f5c1a789d139 req-cc3318c0-d0ab-46a7-b0c1-24d1ff60aa6d service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:52.206806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f2a881c9-1064-4127-85b6-f5c1a789d139 req-cc3318c0-d0ab-46a7-b0c1-24d1ff60aa6d service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:52.248832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-f2a881c9-1064-4127-85b6-f5c1a789d139 req-cc3318c0-d0ab-46a7-b0c1-24d1ff60aa6d service nova] Creating event network-changed:ee2e0f68-7311-4134-9186-6f27cbf5411a for instance 053ba632-5ab2-451f-96b5-adff294a7cb7 on hv-cinder-75996 Feb 17 03:35:52.264314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-f2a881c9-1064-4127-85b6-f5c1a789d139 req-cc3318c0-d0ab-46a7-b0c1-24d1ff60aa6d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085284 Feb 17 03:35:52.265513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 576/1103] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:52.291500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-be2a315b-3347-4b50-b9c2-db8f4c4fece0 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Action: 'create', calling method: .version_select at 0x7f013714f950>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1512308989"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:52.317028 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-be2a315b-3347-4b50-b9c2-db8f4c4fece0 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Getting quotas for project 452d5eab351441619d3b9376e7e200d0. Resources: {'key_pairs'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:35:52.321456 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-be2a315b-3347-4b50-b9c2-db8f4c4fece0 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Getting quotas for user 290a415c3af6474abe44da4a09305695 and project 452d5eab351441619d3b9376e7e200d0. Resources: {'key_pairs'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:35:52.625496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-be2a315b-3347-4b50-b9c2-db8f4c4fece0 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Getting quotas for project 452d5eab351441619d3b9376e7e200d0. Resources: {'key_pairs'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:35:52.630874 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-be2a315b-3347-4b50-b9c2-db8f4c4fece0 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Getting quotas for user 290a415c3af6474abe44da4a09305695 and project 452d5eab351441619d3b9376e7e200d0. Resources: {'key_pairs'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:35:52.646525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-be2a315b-3347-4b50-b9c2-db8f4c4fece0 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.360289 Feb 17 03:35:52.657969 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 577/1104] 10.222.0.46 () {60 vars in 1148 bytes} [Wed Feb 17 03:35:52 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:52.724528 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1349052162", "imageRef": "8511029c-0ea8-4a92-bbdb-c90fc757c39a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1512308989", "networks": [{"uuid": "9145e4f6-0c1b-4b70-ac7f-96d1f58b2aef"}]}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:52.812915 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] validate_networks() for [('9145e4f6-0c1b-4b70-ac7f-96d1f58b2aef', None, None, None)] {{(pid=98183) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:35:53.624048 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-8877fafa-3b2f-41a2-86e9-d60200decb0a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Updating instance_info_cache with network_info: [{"id": "ee2e0f68-7311-4134-9186-6f27cbf5411a", "address": "fa:16:3e:75:b0:c7", "network": {"id": "ed6be5ee-e98f-4e52-85de-7176df4698ac", "bridge": "br-int", "label": "tempest-TestShelveInstance-1617143255-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "62cc4e74ed8a4799a22ac0af1dfb7c4b", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapee2e0f68-73", "ovs_interfaceid": "ee2e0f68-7311-4134-9186-6f27cbf5411a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:35:53.636129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8877fafa-3b2f-41a2-86e9-d60200decb0a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Releasing lock "refresh_cache-053ba632-5ab2-451f-96b5-adff294a7cb7" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:35:53.637065 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8877fafa-3b2f-41a2-86e9-d60200decb0a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/43b9c726-1e25-495c-8654-9cc3617e0ae2" status: 202 len: 0 microversion: 2.1 time: 5.148367 Feb 17 03:35:53.638015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 528/1105] 10.222.0.46 () {58 vars in 1253 bytes} [Wed Feb 17 03:35:48 2021] DELETE /compute/v2.1/os-floating-ips/43b9c726-1e25-495c-8654-9cc3617e0ae2 => generated 0 bytes in 5150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:35:53.652980 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-23993bbf-8876-4cc5-85b8-6cd521d83e6a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:53.653852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-23993bbf-8876-4cc5-85b8-6cd521d83e6a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:53.669298 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23993bbf-8876-4cc5-85b8-6cd521d83e6a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:53.669733 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23993bbf-8876-4cc5-85b8-6cd521d83e6a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:53.670583 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23993bbf-8876-4cc5-85b8-6cd521d83e6a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:53.671077 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-23993bbf-8876-4cc5-85b8-6cd521d83e6a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:53.742317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-23993bbf-8876-4cc5-85b8-6cd521d83e6a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Going to try to terminate instance {{(pid=98184) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:35:53.888878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-23993bbf-8876-4cc5-85b8-6cd521d83e6a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "DELETE /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 204 len: 0 microversion: 2.1 time: 0.245516 Feb 17 03:35:53.889873 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 529/1106] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:35:53 2021] DELETE /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 03:35:53.900037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7fb76188-57dd-4342-b18f-9b061e04a4f8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:53.900670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7fb76188-57dd-4342-b18f-9b061e04a4f8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:53.909113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7fb76188-57dd-4342-b18f-9b061e04a4f8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:53.909529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7fb76188-57dd-4342-b18f-9b061e04a4f8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:53.910372 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7fb76188-57dd-4342-b18f-9b061e04a4f8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:53.910855 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7fb76188-57dd-4342-b18f-9b061e04a4f8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:54.133864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Flavor limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:35:54.134557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Image limits 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:35:54.135207 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Flavor pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:35:54.135846 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Image pref 0:0:0 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:35:54.136411 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:35:54.146179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:54.146799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:54.148906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:54.150520 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:54.183092 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Getting quotas for project 452d5eab351441619d3b9376e7e200d0. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:35:54.188132 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Getting quotas for user 290a415c3af6474abe44da4a09305695 and project 452d5eab351441619d3b9376e7e200d0. Resources: {'instances', 'cores', 'ram'} {{(pid=98183) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:35:54.200088 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Going to run 1 instances... {{(pid=98183) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:35:54.203256 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8511029c-0ea8-4a92-bbdb-c90fc757c39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:35:54.247391 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-7fb76188-57dd-4342-b18f-9b061e04a4f8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:54.257144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7fb76188-57dd-4342-b18f-9b061e04a4f8 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1453 microversion: 2.1 time: 0.362348 Feb 17 03:35:54.257987 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 530/1107] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:53 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1453 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:54.269209 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1c322957-312f-4233-8ae9-76f8d5cda3c8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.550136 Feb 17 03:35:54.270223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 578/1108] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:35:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:35:54.281844 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9b9237ec-0b28-47f1-b0de-63b84872f26c tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:54.282511 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9b9237ec-0b28-47f1-b0de-63b84872f26c tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:54.366327 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9b9237ec-0b28-47f1-b0de-63b84872f26c tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:54.375166 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9b9237ec-0b28-47f1-b0de-63b84872f26c tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1259 microversion: 2.1 time: 0.097612 Feb 17 03:35:54.376018 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 531/1109] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:54 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1259 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:55.277485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-baeea367-74ce-42e0-aeb3-c381d456261e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:55.278198 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-baeea367-74ce-42e0-aeb3-c381d456261e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:55.286454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-baeea367-74ce-42e0-aeb3-c381d456261e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:55.286946 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-baeea367-74ce-42e0-aeb3-c381d456261e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:55.287771 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-baeea367-74ce-42e0-aeb3-c381d456261e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:55.288441 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-baeea367-74ce-42e0-aeb3-c381d456261e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:55.393791 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1d4bddb3-f35d-4ec1-8cc7-bdc12843f8fc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:55.394677 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1d4bddb3-f35d-4ec1-8cc7-bdc12843f8fc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:55.403730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d4bddb3-f35d-4ec1-8cc7-bdc12843f8fc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:55.404593 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d4bddb3-f35d-4ec1-8cc7-bdc12843f8fc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:55.405545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d4bddb3-f35d-4ec1-8cc7-bdc12843f8fc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:55.406254 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1d4bddb3-f35d-4ec1-8cc7-bdc12843f8fc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:55.552889 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-baeea367-74ce-42e0-aeb3-c381d456261e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:55.555467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1d4bddb3-f35d-4ec1-8cc7-bdc12843f8fc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:55.562643 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-baeea367-74ce-42e0-aeb3-c381d456261e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1453 microversion: 2.1 time: 0.289395 Feb 17 03:35:55.564052 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 579/1110] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:55 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1453 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:55.564511 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1d4bddb3-f35d-4ec1-8cc7-bdc12843f8fc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1311 microversion: 2.1 time: 0.174733 Feb 17 03:35:55.565184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 532/1111] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:55 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1311 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:56.593014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c4ba1828-178a-452e-aaa2-81162a6d062b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:56.593594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c4ba1828-178a-452e-aaa2-81162a6d062b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:56.594330 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8cc1569d-011c-4e44-a879-722d0bd9e7b9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:56.595328 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8cc1569d-011c-4e44-a879-722d0bd9e7b9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:56.625180 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c4ba1828-178a-452e-aaa2-81162a6d062b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:56.625681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c4ba1828-178a-452e-aaa2-81162a6d062b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:56.626569 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c4ba1828-178a-452e-aaa2-81162a6d062b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:56.627027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c4ba1828-178a-452e-aaa2-81162a6d062b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:56.633133 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8cc1569d-011c-4e44-a879-722d0bd9e7b9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:56.634189 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8cc1569d-011c-4e44-a879-722d0bd9e7b9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:56.635039 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8cc1569d-011c-4e44-a879-722d0bd9e7b9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:56.635545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8cc1569d-011c-4e44-a879-722d0bd9e7b9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:57.494765 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-c4ba1828-178a-452e-aaa2-81162a6d062b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:57.520807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c4ba1828-178a-452e-aaa2-81162a6d062b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.928180 Feb 17 03:35:57.521568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 533/1112] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:56 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:57.568199 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8cc1569d-011c-4e44-a879-722d0bd9e7b9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:57.585509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8cc1569d-011c-4e44-a879-722d0bd9e7b9 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1453 microversion: 2.1 time: 1.003878 Feb 17 03:35:57.595650 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 580/1113] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:56 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1453 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:57.934286 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-cbf19c3a-2624-4b99-b114-6073071d8d7f req-b023af65-8bd4-409c-8f22-da8a5d4a2bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053ba632-5ab2-451f-96b5-adff294a7cb7", "name": "network-vif-deleted", "tag": "ee2e0f68-7311-4134-9186-6f27cbf5411a"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:57.936200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:57.936200 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:35:57.952263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-cbf19c3a-2624-4b99-b114-6073071d8d7f req-b023af65-8bd4-409c-8f22-da8a5d4a2bbf service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:57.953083 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-cbf19c3a-2624-4b99-b114-6073071d8d7f req-b023af65-8bd4-409c-8f22-da8a5d4a2bbf service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:57.993318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-cbf19c3a-2624-4b99-b114-6073071d8d7f req-b023af65-8bd4-409c-8f22-da8a5d4a2bbf service nova] Creating event network-vif-deleted:ee2e0f68-7311-4134-9186-6f27cbf5411a for instance 053ba632-5ab2-451f-96b5-adff294a7cb7 on hv-cinder-75996 Feb 17 03:35:58.001618 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-cbf19c3a-2624-4b99-b114-6073071d8d7f req-b023af65-8bd4-409c-8f22-da8a5d4a2bbf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078705 Feb 17 03:35:58.003051 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 534/1114] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:58.541504 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9ec1b92f-e288-4a4b-a5db-d4d1eac2798f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:58.542107 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9ec1b92f-e288-4a4b-a5db-d4d1eac2798f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:58.550848 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ec1b92f-e288-4a4b-a5db-d4d1eac2798f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:58.551349 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ec1b92f-e288-4a4b-a5db-d4d1eac2798f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:58.552232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ec1b92f-e288-4a4b-a5db-d4d1eac2798f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:58.552716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9ec1b92f-e288-4a4b-a5db-d4d1eac2798f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:58.614852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-73df6ad2-e694-4b32-9bbf-cfaa37d05eac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:58.615803 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-73df6ad2-e694-4b32-9bbf-cfaa37d05eac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:58.624369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73df6ad2-e694-4b32-9bbf-cfaa37d05eac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:58.624875 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73df6ad2-e694-4b32-9bbf-cfaa37d05eac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:58.625719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73df6ad2-e694-4b32-9bbf-cfaa37d05eac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:58.626358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-73df6ad2-e694-4b32-9bbf-cfaa37d05eac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:58.789511 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-73df6ad2-e694-4b32-9bbf-cfaa37d05eac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:58.800007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-73df6ad2-e694-4b32-9bbf-cfaa37d05eac tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1383 microversion: 2.1 time: 0.190151 Feb 17 03:35:58.800718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 535/1115] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:58 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1383 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:35:58.840378 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9ec1b92f-e288-4a4b-a5db-d4d1eac2798f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:58.849832 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9ec1b92f-e288-4a4b-a5db-d4d1eac2798f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.313040 Feb 17 03:35:58.850454 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 581/1116] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:58 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:59.818153 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4f7c0233-411a-449a-adb7-4a687db418a4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:59.818805 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4f7c0233-411a-449a-adb7-4a687db418a4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:59.828128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f7c0233-411a-449a-adb7-4a687db418a4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:59.828618 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f7c0233-411a-449a-adb7-4a687db418a4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:59.829843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f7c0233-411a-449a-adb7-4a687db418a4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:59.830333 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4f7c0233-411a-449a-adb7-4a687db418a4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:59.868659 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3d7aff61-cffe-4588-8876-b0faf0410199 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:59.869325 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3d7aff61-cffe-4588-8876-b0faf0410199 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:59.877623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d7aff61-cffe-4588-8876-b0faf0410199 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:59.878110 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d7aff61-cffe-4588-8876-b0faf0410199 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:59.878951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d7aff61-cffe-4588-8876-b0faf0410199 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:59.879482 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3d7aff61-cffe-4588-8876-b0faf0410199 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:00.008263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4f7c0233-411a-449a-adb7-4a687db418a4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:00.018849 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4f7c0233-411a-449a-adb7-4a687db418a4 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1383 microversion: 2.1 time: 0.204409 Feb 17 03:36:00.019471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 536/1117] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:59 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1383 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:00.116646 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3d7aff61-cffe-4588-8876-b0faf0410199 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:00.126402 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3d7aff61-cffe-4588-8876-b0faf0410199 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.261707 Feb 17 03:36:00.127183 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 582/1118] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:59 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:36:01.037647 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9d7d60ab-b2e2-4345-9c51-f7ca0cc1f51d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:01.038312 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9d7d60ab-b2e2-4345-9c51-f7ca0cc1f51d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:01.047336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9d7d60ab-b2e2-4345-9c51-f7ca0cc1f51d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:01.047865 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9d7d60ab-b2e2-4345-9c51-f7ca0cc1f51d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:01.048698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9d7d60ab-b2e2-4345-9c51-f7ca0cc1f51d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:01.049331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9d7d60ab-b2e2-4345-9c51-f7ca0cc1f51d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:01.145328 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-47b68b8d-089a-4a77-95ca-9d7bfacd5004 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:01.145985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-47b68b8d-089a-4a77-95ca-9d7bfacd5004 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:01.154036 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-47b68b8d-089a-4a77-95ca-9d7bfacd5004 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:01.154783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-47b68b8d-089a-4a77-95ca-9d7bfacd5004 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:01.155642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-47b68b8d-089a-4a77-95ca-9d7bfacd5004 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:01.156314 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-47b68b8d-089a-4a77-95ca-9d7bfacd5004 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:01.188158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9d7d60ab-b2e2-4345-9c51-f7ca0cc1f51d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:01.199715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9d7d60ab-b2e2-4345-9c51-f7ca0cc1f51d tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1383 microversion: 2.1 time: 0.164382 Feb 17 03:36:01.200693 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 537/1119] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:01 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1383 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:01.391155 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-47b68b8d-089a-4a77-95ca-9d7bfacd5004 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:01.400182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-47b68b8d-089a-4a77-95ca-9d7bfacd5004 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.258810 Feb 17 03:36:01.400825 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 583/1120] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:01 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:02.219596 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1f1cd3b5-e287-4d96-98c2-519237dc8334 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:02.220682 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1f1cd3b5-e287-4d96-98c2-519237dc8334 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:02.229013 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f1cd3b5-e287-4d96-98c2-519237dc8334 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:02.230217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f1cd3b5-e287-4d96-98c2-519237dc8334 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:02.231060 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f1cd3b5-e287-4d96-98c2-519237dc8334 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:02.231566 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1f1cd3b5-e287-4d96-98c2-519237dc8334 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:02.370608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1f1cd3b5-e287-4d96-98c2-519237dc8334 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:02.380006 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1f1cd3b5-e287-4d96-98c2-519237dc8334 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1383 microversion: 2.1 time: 0.164861 Feb 17 03:36:02.380621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 538/1121] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:02 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1383 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:02.419052 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b7ce37d6-cb38-4a94-bec3-6ef7837dd90c tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:02.419772 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b7ce37d6-cb38-4a94-bec3-6ef7837dd90c tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:02.427925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b7ce37d6-cb38-4a94-bec3-6ef7837dd90c tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:02.428427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b7ce37d6-cb38-4a94-bec3-6ef7837dd90c tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:02.429261 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b7ce37d6-cb38-4a94-bec3-6ef7837dd90c tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:02.429749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b7ce37d6-cb38-4a94-bec3-6ef7837dd90c tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:02.647196 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b7ce37d6-cb38-4a94-bec3-6ef7837dd90c tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:02.656685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b7ce37d6-cb38-4a94-bec3-6ef7837dd90c tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.242191 Feb 17 03:36:02.657448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 584/1122] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:02 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:03.398243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-305ed4cd-5cde-4d1d-ac52-7bb866af4139 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:03.398906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-305ed4cd-5cde-4d1d-ac52-7bb866af4139 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:03.407452 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-305ed4cd-5cde-4d1d-ac52-7bb866af4139 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:03.407991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-305ed4cd-5cde-4d1d-ac52-7bb866af4139 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:03.408838 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-305ed4cd-5cde-4d1d-ac52-7bb866af4139 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:03.409335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-305ed4cd-5cde-4d1d-ac52-7bb866af4139 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:03.542326 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-305ed4cd-5cde-4d1d-ac52-7bb866af4139 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:03.552458 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-305ed4cd-5cde-4d1d-ac52-7bb866af4139 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1383 microversion: 2.1 time: 0.158245 Feb 17 03:36:03.553081 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 539/1123] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:03 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1383 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:03.674638 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-aedbb8e9-1019-439a-b8d7-16ebdf0248be tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:03.675762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-aedbb8e9-1019-439a-b8d7-16ebdf0248be tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:03.684313 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aedbb8e9-1019-439a-b8d7-16ebdf0248be tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:03.684901 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aedbb8e9-1019-439a-b8d7-16ebdf0248be tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:03.685888 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aedbb8e9-1019-439a-b8d7-16ebdf0248be tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:03.686949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aedbb8e9-1019-439a-b8d7-16ebdf0248be tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:03.914026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-aedbb8e9-1019-439a-b8d7-16ebdf0248be tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:03.925749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-aedbb8e9-1019-439a-b8d7-16ebdf0248be tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.255157 Feb 17 03:36:03.926697 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 585/1124] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:03 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:04.570699 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0090bab2-50a3-44ce-b39d-d71819af605e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:04.571385 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0090bab2-50a3-44ce-b39d-d71819af605e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:04.579794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0090bab2-50a3-44ce-b39d-d71819af605e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:04.580300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0090bab2-50a3-44ce-b39d-d71819af605e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:04.581136 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0090bab2-50a3-44ce-b39d-d71819af605e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:04.581625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0090bab2-50a3-44ce-b39d-d71819af605e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:04.718551 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0090bab2-50a3-44ce-b39d-d71819af605e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:04.728839 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0090bab2-50a3-44ce-b39d-d71819af605e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1383 microversion: 2.1 time: 0.161958 Feb 17 03:36:04.729636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 540/1125] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:04 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1383 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:04.943989 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ec420355-32fc-48a9-9238-915c77703a86 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:04.944762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ec420355-32fc-48a9-9238-915c77703a86 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:04.952749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ec420355-32fc-48a9-9238-915c77703a86 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:04.953224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ec420355-32fc-48a9-9238-915c77703a86 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:04.954123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ec420355-32fc-48a9-9238-915c77703a86 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:04.954710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ec420355-32fc-48a9-9238-915c77703a86 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:05.170303 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ec420355-32fc-48a9-9238-915c77703a86 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:05.179310 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ec420355-32fc-48a9-9238-915c77703a86 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.239387 Feb 17 03:36:05.180003 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 586/1126] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:04 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:05.747224 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8fd247bf-4460-42d2-8beb-bcc7395e2775 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:05.747997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8fd247bf-4460-42d2-8beb-bcc7395e2775 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:05.755870 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fd247bf-4460-42d2-8beb-bcc7395e2775 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:05.756368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fd247bf-4460-42d2-8beb-bcc7395e2775 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:05.757196 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fd247bf-4460-42d2-8beb-bcc7395e2775 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:05.757676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8fd247bf-4460-42d2-8beb-bcc7395e2775 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:05.892552 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8fd247bf-4460-42d2-8beb-bcc7395e2775 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:05.901675 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8fd247bf-4460-42d2-8beb-bcc7395e2775 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1383 microversion: 2.1 time: 0.158421 Feb 17 03:36:05.902279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 541/1127] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:05 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1383 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:06.198435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-312964d6-6831-47f5-ad03-24a193ddb298 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:06.199652 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-312964d6-6831-47f5-ad03-24a193ddb298 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:06.207802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-312964d6-6831-47f5-ad03-24a193ddb298 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:06.208636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-312964d6-6831-47f5-ad03-24a193ddb298 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:06.209617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-312964d6-6831-47f5-ad03-24a193ddb298 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:06.210114 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-312964d6-6831-47f5-ad03-24a193ddb298 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:06.446822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-312964d6-6831-47f5-ad03-24a193ddb298 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:06.455373 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-312964d6-6831-47f5-ad03-24a193ddb298 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.260884 Feb 17 03:36:06.456341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 587/1128] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:06 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:06.920252 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-404fc47e-5861-4ad7-923d-ab6753496123 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:06.920918 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-404fc47e-5861-4ad7-923d-ab6753496123 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:06.928612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-404fc47e-5861-4ad7-923d-ab6753496123 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:06.929115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-404fc47e-5861-4ad7-923d-ab6753496123 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:06.929943 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-404fc47e-5861-4ad7-923d-ab6753496123 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:06.930431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-404fc47e-5861-4ad7-923d-ab6753496123 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:07.058318 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-404fc47e-5861-4ad7-923d-ab6753496123 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:07.067792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-404fc47e-5861-4ad7-923d-ab6753496123 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1383 microversion: 2.1 time: 0.151355 Feb 17 03:36:07.068670 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 542/1129] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:06 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1383 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:07.474328 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-220aede4-eb21-45fd-a730-84d0e27ba5a9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:07.475259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-220aede4-eb21-45fd-a730-84d0e27ba5a9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:07.484145 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-220aede4-eb21-45fd-a730-84d0e27ba5a9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:07.484843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-220aede4-eb21-45fd-a730-84d0e27ba5a9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:07.486080 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-220aede4-eb21-45fd-a730-84d0e27ba5a9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:07.486737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-220aede4-eb21-45fd-a730-84d0e27ba5a9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:07.708465 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-220aede4-eb21-45fd-a730-84d0e27ba5a9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:07.717520 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-220aede4-eb21-45fd-a730-84d0e27ba5a9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.247497 Feb 17 03:36:07.718341 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 588/1130] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:07 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:08.086516 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9a647deb-c33b-4c7c-bd76-399aa5ccf3e1 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:08.087067 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9a647deb-c33b-4c7c-bd76-399aa5ccf3e1 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:08.094887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a647deb-c33b-4c7c-bd76-399aa5ccf3e1 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:08.095403 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a647deb-c33b-4c7c-bd76-399aa5ccf3e1 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:08.096273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a647deb-c33b-4c7c-bd76-399aa5ccf3e1 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:08.096748 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a647deb-c33b-4c7c-bd76-399aa5ccf3e1 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:08.174673 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a647deb-c33b-4c7c-bd76-399aa5ccf3e1 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:08.175187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a647deb-c33b-4c7c-bd76-399aa5ccf3e1 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:08.175710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-9a647deb-c33b-4c7c-bd76-399aa5ccf3e1 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lazy-loading 'fault' on Instance uuid 053ba632-5ab2-451f-96b5-adff294a7cb7 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:36:08.248431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9a647deb-c33b-4c7c-bd76-399aa5ccf3e1 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49d147b672c945dfb892ccc616d8f184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cc4e74ed8a4799a22ac0af1dfb7c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:08.262728 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9a647deb-c33b-4c7c-bd76-399aa5ccf3e1 tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 200 len: 1224 microversion: 2.1 time: 0.179905 Feb 17 03:36:08.263864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 543/1131] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:08 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 1224 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:08.736113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-83a677df-010a-414d-89e6-724e734c0e31 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:08.736555 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-83a677df-010a-414d-89e6-724e734c0e31 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:08.746830 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83a677df-010a-414d-89e6-724e734c0e31 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:08.747336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83a677df-010a-414d-89e6-724e734c0e31 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:08.748238 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83a677df-010a-414d-89e6-724e734c0e31 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:08.748946 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83a677df-010a-414d-89e6-724e734c0e31 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:08.864997 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-523ba92d-61fc-494f-946d-38d7064bdfcf req-2c253b38-6601-4b89-aee3-8c2e35da4e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91810efd-26bb-4c78-9a55-dbd3949de8c3", "tag": "edf93b48-fcc1-4e49-8e39-c1b15f505afa"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:08.872910 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:08.872910 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:36:08.883459 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-523ba92d-61fc-494f-946d-38d7064bdfcf req-2c253b38-6601-4b89-aee3-8c2e35da4e7e service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:08.884514 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-523ba92d-61fc-494f-946d-38d7064bdfcf req-2c253b38-6601-4b89-aee3-8c2e35da4e7e service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:08.912004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-523ba92d-61fc-494f-946d-38d7064bdfcf req-2c253b38-6601-4b89-aee3-8c2e35da4e7e service nova] Creating event network-changed:edf93b48-fcc1-4e49-8e39-c1b15f505afa for instance 91810efd-26bb-4c78-9a55-dbd3949de8c3 on hv-cinder-75996 Feb 17 03:36:08.917412 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-523ba92d-61fc-494f-946d-38d7064bdfcf req-2c253b38-6601-4b89-aee3-8c2e35da4e7e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056813 Feb 17 03:36:08.918407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 544/1132] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:08.995129 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-83a677df-010a-414d-89e6-724e734c0e31 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:09.004763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-83a677df-010a-414d-89e6-724e734c0e31 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.272871 Feb 17 03:36:09.005594 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 589/1133] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:08 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:09.284229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-897b5054-2f30-429d-8648-8e13ede4695a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:09.285128 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-897b5054-2f30-429d-8648-8e13ede4695a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] [instance: 053ba632-5ab2-451f-96b5-adff294a7cb7] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:09.293741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-897b5054-2f30-429d-8648-8e13ede4695a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:09.294447 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-897b5054-2f30-429d-8648-8e13ede4695a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:09.295555 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-897b5054-2f30-429d-8648-8e13ede4695a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:09.296154 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-897b5054-2f30-429d-8648-8e13ede4695a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:09.351430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-897b5054-2f30-429d-8648-8e13ede4695a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] HTTP exception thrown: Instance 053ba632-5ab2-451f-96b5-adff294a7cb7 could not be found. Feb 17 03:36:09.352140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-897b5054-2f30-429d-8648-8e13ede4695a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Returning 404 to user: Instance 053ba632-5ab2-451f-96b5-adff294a7cb7 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:36:09.353049 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-897b5054-2f30-429d-8648-8e13ede4695a tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7" status: 404 len: 111 microversion: 2.1 time: 0.074144 Feb 17 03:36:09.354270 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 545/1134] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:09 2021] GET /compute/v2.1/servers/053ba632-5ab2-451f-96b5-adff294a7cb7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:36:09.363093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-21cd1496-80b0-464b-9ec8-2a9dfa3caa7e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '.version_select at 0x7f012f082048>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:09.649797 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-21cd1496-80b0-464b-9ec8-2a9dfa3caa7e tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/44ad59c9-be0b-482c-9e48-6f1aefbea8f1" status: 202 len: 0 microversion: 2.1 time: 0.290814 Feb 17 03:36:09.650629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 590/1135] 10.222.0.46 () {58 vars in 1262 bytes} [Wed Feb 17 03:36:09 2021] DELETE /compute/v2.1/os-security-groups/44ad59c9-be0b-482c-9e48-6f1aefbea8f1 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:09.659221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-91591e4d-cdba-4ebd-92e2-540997b854bf tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] Calling method '.version_select at 0x7f012de03510>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:09.686822 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-91591e4d-cdba-4ebd-92e2-540997b854bf tempest-TestShelveInstance-1743512866 tempest-TestShelveInstance-1743512866-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-940726939" status: 202 len: 0 microversion: 2.1 time: 0.031018 Feb 17 03:36:09.687440 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 546/1136] 10.222.0.46 () {58 vars in 1241 bytes} [Wed Feb 17 03:36:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-940726939 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:10.027360 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0bc17d8c-982b-445e-a0f6-ca86bac8707e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:10.028158 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0bc17d8c-982b-445e-a0f6-ca86bac8707e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:10.036471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0bc17d8c-982b-445e-a0f6-ca86bac8707e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:10.037256 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0bc17d8c-982b-445e-a0f6-ca86bac8707e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:10.038288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0bc17d8c-982b-445e-a0f6-ca86bac8707e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:10.039354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0bc17d8c-982b-445e-a0f6-ca86bac8707e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:10.708091 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0bc17d8c-982b-445e-a0f6-ca86bac8707e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:10.722519 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0bc17d8c-982b-445e-a0f6-ca86bac8707e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.699394 Feb 17 03:36:10.724485 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 591/1137] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:10 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:11.746908 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-aa29d2eb-8789-4bce-aba8-edc047e0c06b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:11.748163 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-aa29d2eb-8789-4bce-aba8-edc047e0c06b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:11.762481 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aa29d2eb-8789-4bce-aba8-edc047e0c06b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:11.763285 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aa29d2eb-8789-4bce-aba8-edc047e0c06b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:11.764817 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aa29d2eb-8789-4bce-aba8-edc047e0c06b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:11.765671 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aa29d2eb-8789-4bce-aba8-edc047e0c06b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:12.235899 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-aa29d2eb-8789-4bce-aba8-edc047e0c06b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:12.246761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-aa29d2eb-8789-4bce-aba8-edc047e0c06b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.507070 Feb 17 03:36:12.252229 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 547/1138] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:11 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:12.653221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-1aebe8ce-dbdd-4795-87ac-076be37eab00 req-b72964cc-48de-43ab-8f9a-27be50acef59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91810efd-26bb-4c78-9a55-dbd3949de8c3", "name": "network-vif-plugged", "status": "completed", "tag": "edf93b48-fcc1-4e49-8e39-c1b15f505afa"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:12.655715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:12.655715 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:36:12.673241 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-1aebe8ce-dbdd-4795-87ac-076be37eab00 req-b72964cc-48de-43ab-8f9a-27be50acef59 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:12.673737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-1aebe8ce-dbdd-4795-87ac-076be37eab00 req-b72964cc-48de-43ab-8f9a-27be50acef59 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:12.693014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-1aebe8ce-dbdd-4795-87ac-076be37eab00 req-b72964cc-48de-43ab-8f9a-27be50acef59 service nova] Creating event network-vif-plugged:edf93b48-fcc1-4e49-8e39-c1b15f505afa for instance 91810efd-26bb-4c78-9a55-dbd3949de8c3 on hv-cinder-75996 Feb 17 03:36:12.698683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-1aebe8ce-dbdd-4795-87ac-076be37eab00 req-b72964cc-48de-43ab-8f9a-27be50acef59 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058763 Feb 17 03:36:12.699608 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 592/1139] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:13.266459 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b7f8f4fa-a00a-492c-99c1-4b6fa5c54c84 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:13.267768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b7f8f4fa-a00a-492c-99c1-4b6fa5c54c84 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:13.277043 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b7f8f4fa-a00a-492c-99c1-4b6fa5c54c84 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:13.277557 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b7f8f4fa-a00a-492c-99c1-4b6fa5c54c84 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:13.278386 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b7f8f4fa-a00a-492c-99c1-4b6fa5c54c84 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:13.279048 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b7f8f4fa-a00a-492c-99c1-4b6fa5c54c84 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:13.714394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-b7f8f4fa-a00a-492c-99c1-4b6fa5c54c84 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:13.724409 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b7f8f4fa-a00a-492c-99c1-4b6fa5c54c84 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1359 microversion: 2.1 time: 0.462446 Feb 17 03:36:13.725160 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 548/1140] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:13 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1359 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:14.743244 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2f4a5cc1-0e44-4185-aad4-cf247269c01d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:14.744733 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2f4a5cc1-0e44-4185-aad4-cf247269c01d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:14.753882 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2f4a5cc1-0e44-4185-aad4-cf247269c01d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:14.754525 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2f4a5cc1-0e44-4185-aad4-cf247269c01d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:14.755542 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2f4a5cc1-0e44-4185-aad4-cf247269c01d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:14.756178 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2f4a5cc1-0e44-4185-aad4-cf247269c01d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:15.003744 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2f4a5cc1-0e44-4185-aad4-cf247269c01d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:15.015223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2f4a5cc1-0e44-4185-aad4-cf247269c01d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1550 microversion: 2.1 time: 0.276469 Feb 17 03:36:15.017066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 593/1141] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:14 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1550 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:15.033878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d5fd3ecd-f76c-48d1-aa07-0f8ce88ad2b5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:15.034482 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d5fd3ecd-f76c-48d1-aa07-0f8ce88ad2b5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:15.043789 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d5fd3ecd-f76c-48d1-aa07-0f8ce88ad2b5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:15.044293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d5fd3ecd-f76c-48d1-aa07-0f8ce88ad2b5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:15.045144 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d5fd3ecd-f76c-48d1-aa07-0f8ce88ad2b5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:15.046171 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d5fd3ecd-f76c-48d1-aa07-0f8ce88ad2b5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:15.392210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d5fd3ecd-f76c-48d1-aa07-0f8ce88ad2b5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:15.401691 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d5fd3ecd-f76c-48d1-aa07-0f8ce88ad2b5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1550 microversion: 2.1 time: 0.371792 Feb 17 03:36:15.402505 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 549/1142] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:15 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1550 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:15.423837 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0be3bcbd-0115-4692-a3b8-aff573fa1c17 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:15.429417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:15.429417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:36:15.430978 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0be3bcbd-0115-4692-a3b8-aff573fa1c17 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:15.432304 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0be3bcbd-0115-4692-a3b8-aff573fa1c17 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Searching by: {'deleted': False, 'project_id': '452d5eab351441619d3b9376e7e200d0'} {{(pid=98183) get_all /opt/stack/nova/nova/compute/api.py:2833}} Feb 17 03:36:15.439349 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0be3bcbd-0115-4692-a3b8-aff573fa1c17 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:15.440293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0be3bcbd-0115-4692-a3b8-aff573fa1c17 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:15.441431 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0be3bcbd-0115-4692-a3b8-aff573fa1c17 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:15.442289 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0be3bcbd-0115-4692-a3b8-aff573fa1c17 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:15.564717 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.multi_cell_list [None req-0be3bcbd-0115-4692-a3b8-aff573fa1c17 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=98183) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Feb 17 03:36:15.683642 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0be3bcbd-0115-4692-a3b8-aff573fa1c17 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.265190 Feb 17 03:36:15.691421 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 594/1143] 10.222.0.46 () {58 vars in 1115 bytes} [Wed Feb 17 03:36:15 2021] GET /compute/v2.1/servers => generated 343 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:36:15.701111 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-2c238bc6-00da-4fef-9de1-daf9ee9d749d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:15.701834 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-2c238bc6-00da-4fef-9de1-daf9ee9d749d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:15.710126 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2c238bc6-00da-4fef-9de1-daf9ee9d749d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:15.710627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2c238bc6-00da-4fef-9de1-daf9ee9d749d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:15.711479 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2c238bc6-00da-4fef-9de1-daf9ee9d749d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:15.712001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-2c238bc6-00da-4fef-9de1-daf9ee9d749d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:15.947179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-2c238bc6-00da-4fef-9de1-daf9ee9d749d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:15.958934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-2c238bc6-00da-4fef-9de1-daf9ee9d749d tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1550 microversion: 2.1 time: 0.261141 Feb 17 03:36:15.967070 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 550/1144] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:15 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1550 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:17.958221 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-83fb628c-0200-4baa-8647-068339c7ad62 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a79b3bc-c6c6-4be9-a639-3d971f3d48be"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:17.960027 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-83fb628c-0200-4baa-8647-068339c7ad62 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:17.968493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83fb628c-0200-4baa-8647-068339c7ad62 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:17.969175 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83fb628c-0200-4baa-8647-068339c7ad62 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:17.970181 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83fb628c-0200-4baa-8647-068339c7ad62 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:17.970835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-83fb628c-0200-4baa-8647-068339c7ad62 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:18.403080 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-83fb628c-0200-4baa-8647-068339c7ad62 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "POST /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448922 Feb 17 03:36:18.403761 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 595/1145] 10.222.0.46 () {60 vars in 1313 bytes} [Wed Feb 17 03:36:17 2021] POST /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/os-volume_attachments => generated 194 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:25.609543 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-85228576-b54b-4ffa-bac6-bdaca284ff6e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:25.610193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-85228576-b54b-4ffa-bac6-bdaca284ff6e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:25.618089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-85228576-b54b-4ffa-bac6-bdaca284ff6e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:25.618917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-85228576-b54b-4ffa-bac6-bdaca284ff6e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:25.619957 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-85228576-b54b-4ffa-bac6-bdaca284ff6e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:25.620623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-85228576-b54b-4ffa-bac6-bdaca284ff6e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:25.841497 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-85228576-b54b-4ffa-bac6-bdaca284ff6e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:25.851792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-85228576-b54b-4ffa-bac6-bdaca284ff6e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1596 microversion: 2.1 time: 0.247812 Feb 17 03:36:25.852406 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 551/1146] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:25 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1596 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:25.871208 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9a3e2811-f714-486c-94e2-26ea23fb4294 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Action: 'create', calling method: .version_select at 0x7f012f0820d0>, body: {"pool": null} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:28.191815 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9a3e2811-f714-486c-94e2-26ea23fb4294 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.324975 Feb 17 03:36:28.192473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 596/1147] 10.222.0.46 () {60 vars in 1160 bytes} [Wed Feb 17 03:36:25 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:28.204140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e9aa8f56-8e0e-44fb-81ae-66276b7910a1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.232"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:28.205334 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e9aa8f56-8e0e-44fb-81ae-66276b7910a1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:28.213147 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e9aa8f56-8e0e-44fb-81ae-66276b7910a1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:28.213649 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e9aa8f56-8e0e-44fb-81ae-66276b7910a1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:28.214473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e9aa8f56-8e0e-44fb-81ae-66276b7910a1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:28.215468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e9aa8f56-8e0e-44fb-81ae-66276b7910a1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:28.279034 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e9aa8f56-8e0e-44fb-81ae-66276b7910a1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Acquired lock "refresh_cache-91810efd-26bb-4c78-9a55-dbd3949de8c3" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:36:30.461323 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-e9aa8f56-8e0e-44fb-81ae-66276b7910a1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Building network info cache for instance {{(pid=98184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:36:30.471379 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-eb812914-b423-4f98-8e2e-477057e37f4c req-fd64976a-65fb-458a-850d-c5b1ec714fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91810efd-26bb-4c78-9a55-dbd3949de8c3", "tag": "edf93b48-fcc1-4e49-8e39-c1b15f505afa"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:30.473302 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:30.473302 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:36:30.494887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-eb812914-b423-4f98-8e2e-477057e37f4c req-fd64976a-65fb-458a-850d-c5b1ec714fba service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:30.495344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-eb812914-b423-4f98-8e2e-477057e37f4c req-fd64976a-65fb-458a-850d-c5b1ec714fba service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:30.551115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-eb812914-b423-4f98-8e2e-477057e37f4c req-fd64976a-65fb-458a-850d-c5b1ec714fba service nova] Creating event network-changed:edf93b48-fcc1-4e49-8e39-c1b15f505afa for instance 91810efd-26bb-4c78-9a55-dbd3949de8c3 on hv-cinder-75996 Feb 17 03:36:30.559303 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-eb812914-b423-4f98-8e2e-477057e37f4c req-fd64976a-65fb-458a-850d-c5b1ec714fba service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091874 Feb 17 03:36:30.560553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 597/1148] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:36:32.224243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-e9aa8f56-8e0e-44fb-81ae-66276b7910a1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Updating instance_info_cache with network_info: [{"id": "edf93b48-fcc1-4e49-8e39-c1b15f505afa", "address": "fa:16:3e:05:3f:d9", "network": {"id": "9145e4f6-0c1b-4b70-ac7f-96d1f58b2aef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2031589948-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "452d5eab351441619d3b9376e7e200d0", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapedf93b48-fc", "ovs_interfaceid": "edf93b48-fcc1-4e49-8e39-c1b15f505afa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:36:32.238896 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e9aa8f56-8e0e-44fb-81ae-66276b7910a1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Releasing lock "refresh_cache-91810efd-26bb-4c78-9a55-dbd3949de8c3" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:36:32.240235 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e9aa8f56-8e0e-44fb-81ae-66276b7910a1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "POST /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/action" status: 202 len: 0 microversion: 2.1 time: 4.040082 Feb 17 03:36:32.241764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 552/1149] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:28 2021] POST /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/action => generated 0 bytes in 4042 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 03:36:32.251900 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-186de5a6-4d71-4d8e-b804-a779a0009ce4 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Action: 'create', calling method: .version_select at 0x7f012e50f840>, body: {"security_group": {"name": "tempest-TestMinimumBasicScenario-1451357887", "description": "tempest-TestMinimumBasicScenario-1451357887 description"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:32.667938 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-186de5a6-4d71-4d8e-b804-a779a0009ce4 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 257 microversion: 2.1 time: 0.420990 Feb 17 03:36:32.668576 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 598/1150] 10.222.0.46 () {60 vars in 1170 bytes} [Wed Feb 17 03:36:32 2021] POST /compute/v2.1/os-security-groups => generated 257 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:32.680510 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-82254656-c8db-4f87-9c58-86e938b5b6d6 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Action: 'create', calling method: .version_select at 0x7f012de03488>, body: {"security_group_rule": {"parent_group_id": "4d8513dc-7938-4225-9b3c-8a82c1a4fead", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:32.897617 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-82254656-c8db-4f87-9c58-86e938b5b6d6 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.220954 Feb 17 03:36:32.898344 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 553/1151] 10.222.0.46 () {60 vars in 1185 bytes} [Wed Feb 17 03:36:32 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:32.909593 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-33fd64e1-4bc3-434d-a62c-91883ac5e83f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Action: 'create', calling method: .version_select at 0x7f012e105400>, body: {"security_group_rule": {"parent_group_id": "4d8513dc-7938-4225-9b3c-8a82c1a4fead", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:33.129475 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-33fd64e1-4bc3-434d-a62c-91883ac5e83f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.223696 Feb 17 03:36:33.130437 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 599/1152] 10.222.0.46 () {60 vars in 1185 bytes} [Wed Feb 17 03:36:32 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:33.141322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-c7e291ae-d5f4-4ad9-bcd0-62b2ecabf6f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1451357887"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:33.141878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-c7e291ae-d5f4-4ad9-bcd0-62b2ecabf6f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:33.149640 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c7e291ae-d5f4-4ad9-bcd0-62b2ecabf6f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:33.150140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c7e291ae-d5f4-4ad9-bcd0-62b2ecabf6f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:33.150952 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c7e291ae-d5f4-4ad9-bcd0-62b2ecabf6f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:33.151428 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-c7e291ae-d5f4-4ad9-bcd0-62b2ecabf6f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:33.385233 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.network.security_group_api [None req-c7e291ae-d5f4-4ad9-bcd0-62b2ecabf6f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Adding security group 4d8513dc-7938-4225-9b3c-8a82c1a4fead to port edf93b48-fcc1-4e49-8e39-c1b15f505afa Feb 17 03:36:34.173287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-c7e291ae-d5f4-4ad9-bcd0-62b2ecabf6f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "POST /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/action" status: 202 len: 0 microversion: 2.1 time: 1.036036 Feb 17 03:36:34.173942 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 554/1153] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:33 2021] POST /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/action => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:34.183468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-38e180b2-3310-4eca-b6c9-96927388c62b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:34.183878 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-38e180b2-3310-4eca-b6c9-96927388c62b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:34.193570 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-902fba8b-db98-409f-a8b9-2ca2c47b9ea5 req-61c7cf1f-5d3f-46fd-97d1-93055669093f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91810efd-26bb-4c78-9a55-dbd3949de8c3", "tag": "edf93b48-fcc1-4e49-8e39-c1b15f505afa"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:34.195799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:34.195799 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:36:34.197369 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-38e180b2-3310-4eca-b6c9-96927388c62b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:34.197880 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-38e180b2-3310-4eca-b6c9-96927388c62b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:34.198726 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-38e180b2-3310-4eca-b6c9-96927388c62b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:34.199467 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-38e180b2-3310-4eca-b6c9-96927388c62b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:34.230730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-902fba8b-db98-409f-a8b9-2ca2c47b9ea5 req-61c7cf1f-5d3f-46fd-97d1-93055669093f service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:34.231547 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-902fba8b-db98-409f-a8b9-2ca2c47b9ea5 req-61c7cf1f-5d3f-46fd-97d1-93055669093f service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:34.261982 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-902fba8b-db98-409f-a8b9-2ca2c47b9ea5 req-61c7cf1f-5d3f-46fd-97d1-93055669093f service nova] Creating event network-changed:edf93b48-fcc1-4e49-8e39-c1b15f505afa for instance 91810efd-26bb-4c78-9a55-dbd3949de8c3 on hv-cinder-75996 Feb 17 03:36:34.301300 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-902fba8b-db98-409f-a8b9-2ca2c47b9ea5 req-61c7cf1f-5d3f-46fd-97d1-93055669093f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086727 Feb 17 03:36:34.302374 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 555/1154] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:34.622958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-38e180b2-3310-4eca-b6c9-96927388c62b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:34.633876 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-38e180b2-3310-4eca-b6c9-96927388c62b tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1772 microversion: 2.1 time: 0.455014 Feb 17 03:36:34.634635 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 600/1155] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:34 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1772 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:52.982014 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-87972137-84d9-4ed4-8424-de911870b836 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:52.983202 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-87972137-84d9-4ed4-8424-de911870b836 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:52.991195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-87972137-84d9-4ed4-8424-de911870b836 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:52.991737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-87972137-84d9-4ed4-8424-de911870b836 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:52.992567 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-87972137-84d9-4ed4-8424-de911870b836 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:52.993056 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-87972137-84d9-4ed4-8424-de911870b836 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:53.141906 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-87972137-84d9-4ed4-8424-de911870b836 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "POST /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/action" status: 202 len: 0 microversion: 2.1 time: 0.164407 Feb 17 03:36:53.146509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 556/1156] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:52 2021] POST /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:53.151938 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-53b51871-daa7-4797-9ca8-8eecdaace5f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:53.152603 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-53b51871-daa7-4797-9ca8-8eecdaace5f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:53.161571 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-53b51871-daa7-4797-9ca8-8eecdaace5f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:53.162075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-53b51871-daa7-4797-9ca8-8eecdaace5f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:53.163000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-53b51871-daa7-4797-9ca8-8eecdaace5f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:53.163490 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-53b51871-daa7-4797-9ca8-8eecdaace5f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:53.436354 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-53b51871-daa7-4797-9ca8-8eecdaace5f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:53.445925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-53b51871-daa7-4797-9ca8-8eecdaace5f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1764 microversion: 2.1 time: 0.298044 Feb 17 03:36:53.446540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 601/1157] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:53 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1764 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:54.465214 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3dfe53bd-eeba-4811-8fd2-2de0166a4c59 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:54.465973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3dfe53bd-eeba-4811-8fd2-2de0166a4c59 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:54.474009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3dfe53bd-eeba-4811-8fd2-2de0166a4c59 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:54.474509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3dfe53bd-eeba-4811-8fd2-2de0166a4c59 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:54.475367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3dfe53bd-eeba-4811-8fd2-2de0166a4c59 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:54.475887 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3dfe53bd-eeba-4811-8fd2-2de0166a4c59 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:54.688925 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3dfe53bd-eeba-4811-8fd2-2de0166a4c59 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:54.699071 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3dfe53bd-eeba-4811-8fd2-2de0166a4c59 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1764 microversion: 2.1 time: 0.238346 Feb 17 03:36:54.699688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 557/1158] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:54 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1764 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:55.718035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-47d40e21-47f8-4996-a876-8aa25d51baee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:55.718731 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-47d40e21-47f8-4996-a876-8aa25d51baee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:55.726484 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-47d40e21-47f8-4996-a876-8aa25d51baee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:55.726980 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-47d40e21-47f8-4996-a876-8aa25d51baee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:55.727821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-47d40e21-47f8-4996-a876-8aa25d51baee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:55.728297 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-47d40e21-47f8-4996-a876-8aa25d51baee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:55.945611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-47d40e21-47f8-4996-a876-8aa25d51baee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:55.954859 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-47d40e21-47f8-4996-a876-8aa25d51baee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1769 microversion: 2.1 time: 0.240766 Feb 17 03:36:55.955445 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 602/1159] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:55 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1769 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:56.975902 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cc667559-c32c-4174-a334-b39bb24a3bf7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:56.976801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cc667559-c32c-4174-a334-b39bb24a3bf7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:56.985668 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc667559-c32c-4174-a334-b39bb24a3bf7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:56.986172 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc667559-c32c-4174-a334-b39bb24a3bf7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:56.986999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc667559-c32c-4174-a334-b39bb24a3bf7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:56.987480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc667559-c32c-4174-a334-b39bb24a3bf7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:57.291681 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cc667559-c32c-4174-a334-b39bb24a3bf7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:57.301597 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cc667559-c32c-4174-a334-b39bb24a3bf7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1769 microversion: 2.1 time: 0.331941 Feb 17 03:36:57.302204 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 558/1160] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:56 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1769 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:58.320085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6b14a203-12fe-49c5-8fab-3a2355cf0aec tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:58.320807 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6b14a203-12fe-49c5-8fab-3a2355cf0aec tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:58.328676 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b14a203-12fe-49c5-8fab-3a2355cf0aec tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:58.329177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b14a203-12fe-49c5-8fab-3a2355cf0aec tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:58.329991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b14a203-12fe-49c5-8fab-3a2355cf0aec tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:58.330477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6b14a203-12fe-49c5-8fab-3a2355cf0aec tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:58.558873 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6b14a203-12fe-49c5-8fab-3a2355cf0aec tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:58.568830 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6b14a203-12fe-49c5-8fab-3a2355cf0aec tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1769 microversion: 2.1 time: 0.252613 Feb 17 03:36:58.569546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 603/1161] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:58 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1769 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:59.587033 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-66e88d74-eb93-45b0-80d1-a55c29c2d080 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:59.587717 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-66e88d74-eb93-45b0-80d1-a55c29c2d080 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:59.596055 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-66e88d74-eb93-45b0-80d1-a55c29c2d080 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:59.596545 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-66e88d74-eb93-45b0-80d1-a55c29c2d080 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:59.597356 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-66e88d74-eb93-45b0-80d1-a55c29c2d080 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:59.597833 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-66e88d74-eb93-45b0-80d1-a55c29c2d080 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:59.814859 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-66e88d74-eb93-45b0-80d1-a55c29c2d080 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:59.824131 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-66e88d74-eb93-45b0-80d1-a55c29c2d080 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1769 microversion: 2.1 time: 0.241079 Feb 17 03:36:59.824722 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 559/1162] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:59 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1769 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:00.842999 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-49672f27-09a2-4702-94ec-82960accc4c1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:00.843684 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-49672f27-09a2-4702-94ec-82960accc4c1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:00.851423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-49672f27-09a2-4702-94ec-82960accc4c1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:00.851971 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-49672f27-09a2-4702-94ec-82960accc4c1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:00.852781 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-49672f27-09a2-4702-94ec-82960accc4c1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:00.853262 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-49672f27-09a2-4702-94ec-82960accc4c1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:01.061037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-49672f27-09a2-4702-94ec-82960accc4c1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:01.070263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-49672f27-09a2-4702-94ec-82960accc4c1 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1769 microversion: 2.1 time: 0.231843 Feb 17 03:37:01.070844 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 604/1163] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:00 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1769 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:02.088938 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-161998ba-1ef6-437f-8294-c8ab28db870f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:02.089619 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-161998ba-1ef6-437f-8294-c8ab28db870f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:02.097413 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-161998ba-1ef6-437f-8294-c8ab28db870f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:02.097910 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-161998ba-1ef6-437f-8294-c8ab28db870f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:02.098725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-161998ba-1ef6-437f-8294-c8ab28db870f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:02.099214 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-161998ba-1ef6-437f-8294-c8ab28db870f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:02.313991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-161998ba-1ef6-437f-8294-c8ab28db870f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:02.323323 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-161998ba-1ef6-437f-8294-c8ab28db870f tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1769 microversion: 2.1 time: 0.238391 Feb 17 03:37:02.323951 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 560/1164] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:02 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1769 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:03.341818 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-d401135c-0e59-442a-a688-a76b9ca65dfc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:03.342468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-d401135c-0e59-442a-a688-a76b9ca65dfc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:03.350228 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d401135c-0e59-442a-a688-a76b9ca65dfc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:03.350725 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d401135c-0e59-442a-a688-a76b9ca65dfc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:03.351559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d401135c-0e59-442a-a688-a76b9ca65dfc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:03.352044 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-d401135c-0e59-442a-a688-a76b9ca65dfc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:03.561634 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-d401135c-0e59-442a-a688-a76b9ca65dfc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:03.571377 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-d401135c-0e59-442a-a688-a76b9ca65dfc tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1769 microversion: 2.1 time: 0.233722 Feb 17 03:37:03.572002 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 605/1165] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:03 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1769 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:04.590276 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f94bdd74-cee0-4ff3-92dc-ff45a6d09cb7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:04.590920 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f94bdd74-cee0-4ff3-92dc-ff45a6d09cb7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:04.598623 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f94bdd74-cee0-4ff3-92dc-ff45a6d09cb7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:04.599118 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f94bdd74-cee0-4ff3-92dc-ff45a6d09cb7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:04.599954 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f94bdd74-cee0-4ff3-92dc-ff45a6d09cb7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:04.600435 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f94bdd74-cee0-4ff3-92dc-ff45a6d09cb7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:04.813607 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-f94bdd74-cee0-4ff3-92dc-ff45a6d09cb7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:04.822924 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f94bdd74-cee0-4ff3-92dc-ff45a6d09cb7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1769 microversion: 2.1 time: 0.236679 Feb 17 03:37:04.823544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 561/1166] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:04 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1769 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:05.842509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8ee9c800-2de6-407b-bcf8-4176511ebdee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:05.843096 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8ee9c800-2de6-407b-bcf8-4176511ebdee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:05.851474 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ee9c800-2de6-407b-bcf8-4176511ebdee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:05.852019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ee9c800-2de6-407b-bcf8-4176511ebdee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:05.852834 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ee9c800-2de6-407b-bcf8-4176511ebdee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:05.853315 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ee9c800-2de6-407b-bcf8-4176511ebdee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:06.068001 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8ee9c800-2de6-407b-bcf8-4176511ebdee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:06.077263 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8ee9c800-2de6-407b-bcf8-4176511ebdee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1772 microversion: 2.1 time: 0.238823 Feb 17 03:37:06.077866 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 606/1167] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:05 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1772 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:26.949370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-452726697", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1857685246", "security_groups": [{"name": "tempest-TestVolumeBootPattern-2001516187"}], "block_device_mapping_v2": [{"uuid": "844d9d68-5f5e-41d4-8542-0cc974bac485", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4e746511-e0b4-40cf-9f26-4fcf068fda47"}]}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:27.117858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] validate_networks() for [('4e746511-e0b4-40cf-9f26-4fcf068fda47', None, None, None)] {{(pid=98184) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:37:27.821294 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Flavor limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:37:27.821768 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Image limits 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:37:27.822355 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Flavor pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:37:27.822812 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Image pref 0:0:0 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:37:27.823272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.virt.hardware [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:37:27.832674 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:27.833160 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:27.834031 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:27.834522 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:27.853458 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Getting quotas for project fce55aed27e14d6791193d35e5ac2137. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:37:27.858009 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.quota [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Getting quotas for user a08274bcef1c4e73a39e60b3a11b09d1 and project fce55aed27e14d6791193d35e5ac2137. Resources: {'instances', 'cores', 'ram'} {{(pid=98184) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:37:27.963470 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Going to run 1 instances... {{(pid=98184) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:37:27.965954 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='844d9d68-5f5e-41d4-8542-0cc974bac485',volume_size=None,volume_type=None)] {{(pid=98184) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:37:28.146135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-7031b482-6863-45a8-8a20-08e71048b580 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.200858 Feb 17 03:37:28.146826 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 562/1168] 10.222.0.46 () {60 vars in 1137 bytes} [Wed Feb 17 03:37:26 2021] POST /compute/v2.1/servers => generated 413 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:37:28.157544 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9cc61172-02e4-4cdd-9063-6b5d5c5e31d9 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:28.158208 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9cc61172-02e4-4cdd-9063-6b5d5c5e31d9 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:28.239570 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9cc61172-02e4-4cdd-9063-6b5d5c5e31d9 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:28.248307 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9cc61172-02e4-4cdd-9063-6b5d5c5e31d9 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1094 microversion: 2.1 time: 0.094776 Feb 17 03:37:28.249135 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 607/1169] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:28 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:29.264125 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e681a05a-d5d7-44c2-8c55-709926671430] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 17 03:37:29.267661 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9a38af46-d066-4b3a-99ff-24f1664b0d75 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:29.268313 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9a38af46-d066-4b3a-99ff-24f1664b0d75 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:29.277307 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a38af46-d066-4b3a-99ff-24f1664b0d75 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:29.277806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a38af46-d066-4b3a-99ff-24f1664b0d75 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:29.278625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a38af46-d066-4b3a-99ff-24f1664b0d75 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:29.279109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a38af46-d066-4b3a-99ff-24f1664b0d75 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:29.402190 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9a38af46-d066-4b3a-99ff-24f1664b0d75 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:29.413453 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9a38af46-d066-4b3a-99ff-24f1664b0d75 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1192 microversion: 2.1 time: 0.150817 Feb 17 03:37:29.414234 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 563/1170] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:29 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1192 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:30.434621 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6a3a3ce6-ad8d-458e-8550-914d461f749c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:30.436105 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6a3a3ce6-ad8d-458e-8550-914d461f749c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:30.444265 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6a3a3ce6-ad8d-458e-8550-914d461f749c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:30.445086 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6a3a3ce6-ad8d-458e-8550-914d461f749c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:30.446260 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6a3a3ce6-ad8d-458e-8550-914d461f749c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:30.446846 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6a3a3ce6-ad8d-458e-8550-914d461f749c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:30.606450 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6a3a3ce6-ad8d-458e-8550-914d461f749c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:30.617439 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6a3a3ce6-ad8d-458e-8550-914d461f749c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1210 microversion: 2.1 time: 0.186415 Feb 17 03:37:30.618053 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 608/1171] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:30 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1210 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:31.636295 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-25999e73-6539-4689-aef1-ce3cb680c4b8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:31.637109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-25999e73-6539-4689-aef1-ce3cb680c4b8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:31.656846 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25999e73-6539-4689-aef1-ce3cb680c4b8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:31.657358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25999e73-6539-4689-aef1-ce3cb680c4b8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:31.658210 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25999e73-6539-4689-aef1-ce3cb680c4b8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:31.658706 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-25999e73-6539-4689-aef1-ce3cb680c4b8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:31.714048 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] [e681a05a-d5d7-44c2-8c55-709926671430] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 59260. Feb 17 03:37:32.529206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-25999e73-6539-4689-aef1-ce3cb680c4b8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:32.538585 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-25999e73-6539-4689-aef1-ce3cb680c4b8 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1273 microversion: 2.1 time: 0.906356 Feb 17 03:37:32.539194 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 564/1172] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:31 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1273 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:33.024072 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-c0e0f643-91e9-42cb-a0f2-dcb947e3adda req-34be97d7-2213-4b11-8a5d-23e7bd4f4aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0207f5fc-d1d8-495e-abed-39b09228824c", "tag": "a464a31e-93f8-4268-9196-2112eb20fd88"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:33.025845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:37:33.025845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:37:33.034985 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-c0e0f643-91e9-42cb-a0f2-dcb947e3adda req-34be97d7-2213-4b11-8a5d-23e7bd4f4aa4 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:33.035540 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-c0e0f643-91e9-42cb-a0f2-dcb947e3adda req-34be97d7-2213-4b11-8a5d-23e7bd4f4aa4 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:33.053058 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-c0e0f643-91e9-42cb-a0f2-dcb947e3adda req-34be97d7-2213-4b11-8a5d-23e7bd4f4aa4 service nova] Creating event network-changed:a464a31e-93f8-4268-9196-2112eb20fd88 for instance 0207f5fc-d1d8-495e-abed-39b09228824c on hv-cinder-75996 Feb 17 03:37:33.058388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-c0e0f643-91e9-42cb-a0f2-dcb947e3adda req-34be97d7-2213-4b11-8a5d-23e7bd4f4aa4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180778 Feb 17 03:37:33.059112 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 609/1173] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:37:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:37:33.557389 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-689b02cc-3d9c-438c-8f6e-19452b13d5a3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:33.558050 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-689b02cc-3d9c-438c-8f6e-19452b13d5a3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:33.565806 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-689b02cc-3d9c-438c-8f6e-19452b13d5a3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:33.566307 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-689b02cc-3d9c-438c-8f6e-19452b13d5a3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:33.567732 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-689b02cc-3d9c-438c-8f6e-19452b13d5a3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:33.568216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-689b02cc-3d9c-438c-8f6e-19452b13d5a3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:33.938553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-689b02cc-3d9c-438c-8f6e-19452b13d5a3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:33.947321 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-689b02cc-3d9c-438c-8f6e-19452b13d5a3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1273 microversion: 2.1 time: 0.393901 Feb 17 03:37:33.947952 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 565/1174] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:33 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1273 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:34.965981 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9bf41657-8037-4fff-a69e-9ef0d6adfeef tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:34.966795 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9bf41657-8037-4fff-a69e-9ef0d6adfeef tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:34.975399 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bf41657-8037-4fff-a69e-9ef0d6adfeef tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:34.975929 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bf41657-8037-4fff-a69e-9ef0d6adfeef tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:34.976755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bf41657-8037-4fff-a69e-9ef0d6adfeef tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:34.977244 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9bf41657-8037-4fff-a69e-9ef0d6adfeef tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:35.190567 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9bf41657-8037-4fff-a69e-9ef0d6adfeef tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:35.199472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9bf41657-8037-4fff-a69e-9ef0d6adfeef tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1273 microversion: 2.1 time: 0.237963 Feb 17 03:37:35.200104 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 610/1175] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:34 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:37:36.218713 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9e41cd5f-de81-4afc-af6b-40fd5137ebbb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:36.219374 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9e41cd5f-de81-4afc-af6b-40fd5137ebbb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:36.227182 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e41cd5f-de81-4afc-af6b-40fd5137ebbb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:36.227741 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e41cd5f-de81-4afc-af6b-40fd5137ebbb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:36.229087 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e41cd5f-de81-4afc-af6b-40fd5137ebbb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:36.229574 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9e41cd5f-de81-4afc-af6b-40fd5137ebbb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:36.437439 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9e41cd5f-de81-4afc-af6b-40fd5137ebbb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:36.446159 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9e41cd5f-de81-4afc-af6b-40fd5137ebbb tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1273 microversion: 2.1 time: 0.231838 Feb 17 03:37:36.446756 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 566/1176] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:36 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1273 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:37.464124 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-ca7103a7-1978-41a2-9995-0dd9c53c5528 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:37.464784 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-ca7103a7-1978-41a2-9995-0dd9c53c5528 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:37.472551 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ca7103a7-1978-41a2-9995-0dd9c53c5528 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:37.473045 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ca7103a7-1978-41a2-9995-0dd9c53c5528 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:37.473857 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ca7103a7-1978-41a2-9995-0dd9c53c5528 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:37.474337 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-ca7103a7-1978-41a2-9995-0dd9c53c5528 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:37.690903 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-ca7103a7-1978-41a2-9995-0dd9c53c5528 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:37.702120 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-ca7103a7-1978-41a2-9995-0dd9c53c5528 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1273 microversion: 2.1 time: 0.241886 Feb 17 03:37:37.702898 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 611/1177] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:37 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:38.720828 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8ab62ce5-ce85-41b5-b8e8-f7a05e62f950 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:38.721478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8ab62ce5-ce85-41b5-b8e8-f7a05e62f950 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:38.729257 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ab62ce5-ce85-41b5-b8e8-f7a05e62f950 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:38.729749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ab62ce5-ce85-41b5-b8e8-f7a05e62f950 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:38.730819 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ab62ce5-ce85-41b5-b8e8-f7a05e62f950 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:38.731299 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8ab62ce5-ce85-41b5-b8e8-f7a05e62f950 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:38.937553 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-8ab62ce5-ce85-41b5-b8e8-f7a05e62f950 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:38.946176 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8ab62ce5-ce85-41b5-b8e8-f7a05e62f950 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1273 microversion: 2.1 time: 0.229362 Feb 17 03:37:38.946769 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 567/1178] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:38 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1273 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:38.992883 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f24b491e-6ad1-42e0-99b2-4f2d25dedfbb tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1451357887"}} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:38.993407 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f24b491e-6ad1-42e0-99b2-4f2d25dedfbb tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:39.001783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f24b491e-6ad1-42e0-99b2-4f2d25dedfbb tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:39.002287 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f24b491e-6ad1-42e0-99b2-4f2d25dedfbb tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:39.003113 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f24b491e-6ad1-42e0-99b2-4f2d25dedfbb tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:39.003639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f24b491e-6ad1-42e0-99b2-4f2d25dedfbb tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:39.210559 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.network.security_group_api [None req-f24b491e-6ad1-42e0-99b2-4f2d25dedfbb tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Removing security group 4d8513dc-7938-4225-9b3c-8a82c1a4fead from port edf93b48-fcc1-4e49-8e39-c1b15f505afa Feb 17 03:37:39.915331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f24b491e-6ad1-42e0-99b2-4f2d25dedfbb tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "POST /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/action" status: 202 len: 0 microversion: 2.1 time: 0.926566 Feb 17 03:37:39.916307 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 612/1179] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:38 2021] POST /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/action => generated 0 bytes in 928 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:39.923804 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-9510977e-24e1-42f9-b653-566b05e24c13 req-999c528e-6d32-4077-bd36-f6f968a3d3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91810efd-26bb-4c78-9a55-dbd3949de8c3", "tag": "edf93b48-fcc1-4e49-8e39-c1b15f505afa"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:39.924658 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-16bce2a0-1dca-45a1-8ff3-f94376601c0e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '.version_select at 0x7f012e50fb70>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:39.925900 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:37:39.925900 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:37:39.935430 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-9510977e-24e1-42f9-b653-566b05e24c13 req-999c528e-6d32-4077-bd36-f6f968a3d3c6 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:39.935934 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-9510977e-24e1-42f9-b653-566b05e24c13 req-999c528e-6d32-4077-bd36-f6f968a3d3c6 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:39.955629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-9510977e-24e1-42f9-b653-566b05e24c13 req-999c528e-6d32-4077-bd36-f6f968a3d3c6 service nova] Creating event network-changed:edf93b48-fcc1-4e49-8e39-c1b15f505afa for instance 91810efd-26bb-4c78-9a55-dbd3949de8c3 on hv-cinder-75996 Feb 17 03:37:39.961106 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-9510977e-24e1-42f9-b653-566b05e24c13 req-999c528e-6d32-4077-bd36-f6f968a3d3c6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041242 Feb 17 03:37:39.961979 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 568/1180] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:37:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:37:39.968378 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-4bb5c2ad-e5b0-4af3-b805-86aa5bf2e660 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:39.969185 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-4bb5c2ad-e5b0-4af3-b805-86aa5bf2e660 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:39.977776 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4bb5c2ad-e5b0-4af3-b805-86aa5bf2e660 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:39.978279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4bb5c2ad-e5b0-4af3-b805-86aa5bf2e660 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:39.979115 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4bb5c2ad-e5b0-4af3-b805-86aa5bf2e660 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:39.979625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-4bb5c2ad-e5b0-4af3-b805-86aa5bf2e660 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:40.489814 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-4bb5c2ad-e5b0-4af3-b805-86aa5bf2e660 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:40.499638 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-4bb5c2ad-e5b0-4af3-b805-86aa5bf2e660 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1273 microversion: 2.1 time: 0.536246 Feb 17 03:37:40.500247 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 569/1181] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:39 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1273 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:40.607987 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-16bce2a0-1dca-45a1-8ff3-f94376601c0e tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/4d8513dc-7938-4225-9b3c-8a82c1a4fead" status: 202 len: 0 microversion: 2.1 time: 0.687188 Feb 17 03:37:40.609447 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 613/1182] 10.222.0.46 () {58 vars in 1262 bytes} [Wed Feb 17 03:37:39 2021] DELETE /compute/v2.1/os-security-groups/4d8513dc-7938-4225-9b3c-8a82c1a4fead => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:37:40.621533 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-b4fba2ec-99f4-4c94-b79c-abca8aee8134 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '.version_select at 0x7f012de03378>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:41.518516 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-0383a48e-70c4-4773-9967-2d8e5d42f248 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:41.519179 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-0383a48e-70c4-4773-9967-2d8e5d42f248 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:41.527123 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0383a48e-70c4-4773-9967-2d8e5d42f248 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:41.527672 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0383a48e-70c4-4773-9967-2d8e5d42f248 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:41.529079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0383a48e-70c4-4773-9967-2d8e5d42f248 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:41.529569 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-0383a48e-70c4-4773-9967-2d8e5d42f248 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:41.587400 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-b4fba2ec-99f4-4c94-b79c-abca8aee8134 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:41.596696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4fba2ec-99f4-4c94-b79c-abca8aee8134 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:41.597208 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4fba2ec-99f4-4c94-b79c-abca8aee8134 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:41.598214 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4fba2ec-99f4-4c94-b79c-abca8aee8134 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:41.598710 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4fba2ec-99f4-4c94-b79c-abca8aee8134 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:41.662931 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4fba2ec-99f4-4c94-b79c-abca8aee8134 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Acquired lock "refresh_cache-91810efd-26bb-4c78-9a55-dbd3949de8c3" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:37:42.152905 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-0383a48e-70c4-4773-9967-2d8e5d42f248 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:42.161587 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-0383a48e-70c4-4773-9967-2d8e5d42f248 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1273 microversion: 2.1 time: 0.646993 Feb 17 03:37:42.162187 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 614/1183] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:41 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1273 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:42.236657 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-abcdb4e8-d4f8-4e0b-aaa3-b65a69897ad8 req-f68f2199-5163-4422-a06c-894db2fef577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0207f5fc-d1d8-495e-abed-39b09228824c", "name": "network-vif-plugged", "status": "completed", "tag": "a464a31e-93f8-4268-9196-2112eb20fd88"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:42.238662 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:37:42.238662 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:37:42.248335 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-abcdb4e8-d4f8-4e0b-aaa3-b65a69897ad8 req-f68f2199-5163-4422-a06c-894db2fef577 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:42.248918 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-abcdb4e8-d4f8-4e0b-aaa3-b65a69897ad8 req-f68f2199-5163-4422-a06c-894db2fef577 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:42.266519 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-abcdb4e8-d4f8-4e0b-aaa3-b65a69897ad8 req-f68f2199-5163-4422-a06c-894db2fef577 service nova] Creating event network-vif-plugged:a464a31e-93f8-4268-9196-2112eb20fd88 for instance 0207f5fc-d1d8-495e-abed-39b09228824c on hv-cinder-75996 Feb 17 03:37:42.272067 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-abcdb4e8-d4f8-4e0b-aaa3-b65a69897ad8 req-f68f2199-5163-4422-a06c-894db2fef577 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098682 Feb 17 03:37:42.272835 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 615/1184] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:37:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:37:43.180150 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6f0e7c9e-27e5-497f-a6a4-f1c6cd641997 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:43.180916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6f0e7c9e-27e5-497f-a6a4-f1c6cd641997 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:43.188994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6f0e7c9e-27e5-497f-a6a4-f1c6cd641997 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:43.189500 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6f0e7c9e-27e5-497f-a6a4-f1c6cd641997 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:43.190529 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6f0e7c9e-27e5-497f-a6a4-f1c6cd641997 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:43.191096 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6f0e7c9e-27e5-497f-a6a4-f1c6cd641997 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:43.885794 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-6f0e7c9e-27e5-497f-a6a4-f1c6cd641997 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:43.894971 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6f0e7c9e-27e5-497f-a6a4-f1c6cd641997 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1273 microversion: 2.1 time: 0.719314 Feb 17 03:37:43.895696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 616/1185] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:43 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1273 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:37:44.017826 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-b4fba2ec-99f4-4c94-b79c-abca8aee8134 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Building network info cache for instance {{(pid=98184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:37:44.027042 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-e6cd85b3-ea17-42f0-9fb0-caebfc0ecf97 req-a6b299f0-2818-45fe-8cdc-f4cb4a2860ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91810efd-26bb-4c78-9a55-dbd3949de8c3", "tag": "edf93b48-fcc1-4e49-8e39-c1b15f505afa"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:44.029216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:37:44.029216 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:37:44.038089 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-e6cd85b3-ea17-42f0-9fb0-caebfc0ecf97 req-a6b299f0-2818-45fe-8cdc-f4cb4a2860ef service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:44.038593 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-e6cd85b3-ea17-42f0-9fb0-caebfc0ecf97 req-a6b299f0-2818-45fe-8cdc-f4cb4a2860ef service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:44.056477 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-e6cd85b3-ea17-42f0-9fb0-caebfc0ecf97 req-a6b299f0-2818-45fe-8cdc-f4cb4a2860ef service nova] Creating event network-changed:edf93b48-fcc1-4e49-8e39-c1b15f505afa for instance 91810efd-26bb-4c78-9a55-dbd3949de8c3 on hv-cinder-75996 Feb 17 03:37:44.061541 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-e6cd85b3-ea17-42f0-9fb0-caebfc0ecf97 req-a6b299f0-2818-45fe-8cdc-f4cb4a2860ef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038404 Feb 17 03:37:44.062358 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 617/1186] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:37:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:37:44.914252 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-cc995d12-85ee-486f-9589-17920a48a7fe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:44.915000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-cc995d12-85ee-486f-9589-17920a48a7fe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:44.923922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc995d12-85ee-486f-9589-17920a48a7fe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:44.924556 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc995d12-85ee-486f-9589-17920a48a7fe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:44.925472 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc995d12-85ee-486f-9589-17920a48a7fe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:44.926037 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-cc995d12-85ee-486f-9589-17920a48a7fe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.445108 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-b4fba2ec-99f4-4c94-b79c-abca8aee8134 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Updating instance_info_cache with network_info: [{"id": "edf93b48-fcc1-4e49-8e39-c1b15f505afa", "address": "fa:16:3e:05:3f:d9", "network": {"id": "9145e4f6-0c1b-4b70-ac7f-96d1f58b2aef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2031589948-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "452d5eab351441619d3b9376e7e200d0", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapedf93b48-fc", "ovs_interfaceid": "edf93b48-fcc1-4e49-8e39-c1b15f505afa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:37:45.451730 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-cc995d12-85ee-486f-9589-17920a48a7fe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:45.456419 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-b4fba2ec-99f4-4c94-b79c-abca8aee8134 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Releasing lock "refresh_cache-91810efd-26bb-4c78-9a55-dbd3949de8c3" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:37:45.457722 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-b4fba2ec-99f4-4c94-b79c-abca8aee8134 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/64c0c4f4-6eb0-479b-bb1b-509769579fb3" status: 202 len: 0 microversion: 2.1 time: 4.840236 Feb 17 03:37:45.459375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 570/1187] 10.222.0.46 () {58 vars in 1253 bytes} [Wed Feb 17 03:37:40 2021] DELETE /compute/v2.1/os-floating-ips/64c0c4f4-6eb0-479b-bb1b-509769579fb3 => generated 0 bytes in 4843 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:45.464935 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-cc995d12-85ee-486f-9589-17920a48a7fe tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1460 microversion: 2.1 time: 0.555683 Feb 17 03:37:45.466138 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 618/1188] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:44 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1460 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:45.468463 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5021f8d5-7b04-405b-bdeb-383bf2102ae5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:45.469000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5021f8d5-7b04-405b-bdeb-383bf2102ae5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:45.477515 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5021f8d5-7b04-405b-bdeb-383bf2102ae5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:45.477805 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5021f8d5-7b04-405b-bdeb-383bf2102ae5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.478639 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5021f8d5-7b04-405b-bdeb-383bf2102ae5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:45.479288 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5021f8d5-7b04-405b-bdeb-383bf2102ae5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.483446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-aadbc829-5555-4a2d-81b6-4962f159f856 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:45.484273 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-aadbc829-5555-4a2d-81b6-4962f159f856 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:45.492959 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aadbc829-5555-4a2d-81b6-4962f159f856 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:45.493464 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aadbc829-5555-4a2d-81b6-4962f159f856 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.494418 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aadbc829-5555-4a2d-81b6-4962f159f856 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:45.495053 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-aadbc829-5555-4a2d-81b6-4962f159f856 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.663649 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.objects.instance [None req-5021f8d5-7b04-405b-bdeb-383bf2102ae5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lazy-loading 'services' on Instance uuid 91810efd-26bb-4c78-9a55-dbd3949de8c3 {{(pid=98184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:37:45.742781 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-aadbc829-5555-4a2d-81b6-4962f159f856 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:45.752282 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-aadbc829-5555-4a2d-81b6-4962f159f856 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1460 microversion: 2.1 time: 0.273153 Feb 17 03:37:45.752964 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 619/1189] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:45 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1460 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:45.770279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-237b2a72-a3fa-49af-acbb-f45d40dba91c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'create', calling method: .version_select at 0x7f012efc1598>, body: {"pool": null} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:45.806885 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5021f8d5-7b04-405b-bdeb-383bf2102ae5 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "DELETE /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/os-volume_attachments/7a79b3bc-c6c6-4be9-a639-3d971f3d48be" status: 202 len: 0 microversion: 2.1 time: 0.342728 Feb 17 03:37:45.807629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 571/1190] 10.222.0.46 () {58 vars in 1406 bytes} [Wed Feb 17 03:37:45 2021] DELETE /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/os-volume_attachments/7a79b3bc-c6c6-4be9-a639-3d971f3d48be => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:37:45.817473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-901609ec-af58-4a73-bc14-2c9319704bab tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:45.818708 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-901609ec-af58-4a73-bc14-2c9319704bab tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:45.827322 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-901609ec-af58-4a73-bc14-2c9319704bab tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:45.827858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-901609ec-af58-4a73-bc14-2c9319704bab tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.828700 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-901609ec-af58-4a73-bc14-2c9319704bab tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:45.829252 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-901609ec-af58-4a73-bc14-2c9319704bab tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.898692 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-901609ec-af58-4a73-bc14-2c9319704bab tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085495 Feb 17 03:37:45.899685 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 572/1191] 10.222.0.46 () {58 vars in 1292 bytes} [Wed Feb 17 03:37:45 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:37:46.911011 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-047e7328-af7d-4542-9181-bff690fce95a tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:46.912084 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-047e7328-af7d-4542-9181-bff690fce95a tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:46.920057 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-047e7328-af7d-4542-9181-bff690fce95a tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:46.920516 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-047e7328-af7d-4542-9181-bff690fce95a tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:46.921208 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-047e7328-af7d-4542-9181-bff690fce95a tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:46.921706 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-047e7328-af7d-4542-9181-bff690fce95a tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:46.988520 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-047e7328-af7d-4542-9181-bff690fce95a tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081702 Feb 17 03:37:46.989152 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 573/1192] 10.222.0.46 () {58 vars in 1292 bytes} [Wed Feb 17 03:37:46 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 03:37:47.000857 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-53bae8f7-ad74-4603-a763-1e3956f5d688 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:47.001274 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-53bae8f7-ad74-4603-a763-1e3956f5d688 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:47.009070 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-53bae8f7-ad74-4603-a763-1e3956f5d688 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:47.009572 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-53bae8f7-ad74-4603-a763-1e3956f5d688 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:47.010405 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-53bae8f7-ad74-4603-a763-1e3956f5d688 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:47.010892 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-53bae8f7-ad74-4603-a763-1e3956f5d688 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:47.175019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-53bae8f7-ad74-4603-a763-1e3956f5d688 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] HTTP exception thrown: Instance 91810efd-26bb-4c78-9a55-dbd3949de8c3 is not attached to volume 7a79b3bc-c6c6-4be9-a639-3d971f3d48be Feb 17 03:37:47.175723 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-53bae8f7-ad74-4603-a763-1e3956f5d688 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Returning 404 to user: Instance 91810efd-26bb-4c78-9a55-dbd3949de8c3 is not attached to volume 7a79b3bc-c6c6-4be9-a639-3d971f3d48be {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:37:47.176629 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-53bae8f7-ad74-4603-a763-1e3956f5d688 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "DELETE /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/os-volume_attachments/7a79b3bc-c6c6-4be9-a639-3d971f3d48be" status: 404 len: 154 microversion: 2.1 time: 0.180970 Feb 17 03:37:47.177239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 574/1193] 10.222.0.46 () {58 vars in 1406 bytes} [Wed Feb 17 03:37:46 2021] DELETE /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3/os-volume_attachments/7a79b3bc-c6c6-4be9-a639-3d971f3d48be => generated 154 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:37:48.040099 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-237b2a72-a3fa-49af-acbb-f45d40dba91c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.273468 Feb 17 03:37:48.040748 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 620/1194] 10.222.0.46 () {60 vars in 1160 bytes} [Wed Feb 17 03:37:45 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:37:48.052239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9f3b5592-997e-4add-92e3-79bce2d6e1e7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.131"}} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:48.053424 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9f3b5592-997e-4add-92e3-79bce2d6e1e7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:48.065511 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f3b5592-997e-4add-92e3-79bce2d6e1e7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:48.066015 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f3b5592-997e-4add-92e3-79bce2d6e1e7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:48.066852 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f3b5592-997e-4add-92e3-79bce2d6e1e7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:48.067342 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f3b5592-997e-4add-92e3-79bce2d6e1e7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:48.130689 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f3b5592-997e-4add-92e3-79bce2d6e1e7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Acquired lock "refresh_cache-0207f5fc-d1d8-495e-abed-39b09228824c" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:37:48.452255 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6363cfa2-802b-455e-94a8-a98ac799d3f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:48.452817 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6363cfa2-802b-455e-94a8-a98ac799d3f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:48.461068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6363cfa2-802b-455e-94a8-a98ac799d3f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:48.461566 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6363cfa2-802b-455e-94a8-a98ac799d3f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:48.462384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6363cfa2-802b-455e-94a8-a98ac799d3f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:48.462864 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-6363cfa2-802b-455e-94a8-a98ac799d3f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:48.528471 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-6363cfa2-802b-455e-94a8-a98ac799d3f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Going to try to terminate instance {{(pid=98183) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:37:48.644532 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6363cfa2-802b-455e-94a8-a98ac799d3f9 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "DELETE /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 204 len: 0 microversion: 2.1 time: 0.195897 Feb 17 03:37:48.645826 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 621/1195] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:37:48 2021] DELETE /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 03:37:48.655480 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-3f49941f-651f-4c4d-afcb-21de3fdb7ca4 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:48.656255 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-3f49941f-651f-4c4d-afcb-21de3fdb7ca4 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:48.663893 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3f49941f-651f-4c4d-afcb-21de3fdb7ca4 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:48.664393 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3f49941f-651f-4c4d-afcb-21de3fdb7ca4 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:48.665438 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3f49941f-651f-4c4d-afcb-21de3fdb7ca4 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:48.665919 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-3f49941f-651f-4c4d-afcb-21de3fdb7ca4 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:49.159478 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-3f49941f-651f-4c4d-afcb-21de3fdb7ca4 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:49.168349 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-3f49941f-651f-4c4d-afcb-21de3fdb7ca4 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1556 microversion: 2.1 time: 0.517680 Feb 17 03:37:49.169455 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 622/1196] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:48 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1556 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:37:50.187130 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-39fde642-2275-4a70-91a2-8bfa366f99a7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:50.187783 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-39fde642-2275-4a70-91a2-8bfa366f99a7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:50.196683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-39fde642-2275-4a70-91a2-8bfa366f99a7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:50.197185 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-39fde642-2275-4a70-91a2-8bfa366f99a7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:50.198035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-39fde642-2275-4a70-91a2-8bfa366f99a7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:50.198533 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-39fde642-2275-4a70-91a2-8bfa366f99a7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:50.247457 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-9f3b5592-997e-4add-92e3-79bce2d6e1e7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Building network info cache for instance {{(pid=98184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:37:50.581359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-39fde642-2275-4a70-91a2-8bfa366f99a7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:50.590297 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-39fde642-2275-4a70-91a2-8bfa366f99a7 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1556 microversion: 2.1 time: 0.407207 Feb 17 03:37:50.591717 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 623/1197] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:50 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1556 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:50.596738 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-4e0e231a-4210-4c11-934f-26a101cfd40d req-75563cb8-1db8-41ab-a134-90a2e04cfa74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0207f5fc-d1d8-495e-abed-39b09228824c", "tag": "a464a31e-93f8-4268-9196-2112eb20fd88"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:50.598446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:37:50.598446 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:37:50.607350 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-4e0e231a-4210-4c11-934f-26a101cfd40d req-75563cb8-1db8-41ab-a134-90a2e04cfa74 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:50.608053 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-4e0e231a-4210-4c11-934f-26a101cfd40d req-75563cb8-1db8-41ab-a134-90a2e04cfa74 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:50.629889 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-4e0e231a-4210-4c11-934f-26a101cfd40d req-75563cb8-1db8-41ab-a134-90a2e04cfa74 service nova] Creating event network-changed:a464a31e-93f8-4268-9196-2112eb20fd88 for instance 0207f5fc-d1d8-495e-abed-39b09228824c on hv-cinder-75996 Feb 17 03:37:50.634912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-4e0e231a-4210-4c11-934f-26a101cfd40d req-75563cb8-1db8-41ab-a134-90a2e04cfa74 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042094 Feb 17 03:37:50.635723 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 624/1198] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:37:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:37:51.127613 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-f7613fec-079a-41b0-9c10-ef9d4006a4a9 req-82583964-3ebc-4aa9-bc66-bd904904f841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91810efd-26bb-4c78-9a55-dbd3949de8c3", "name": "network-vif-unplugged", "status": "completed", "tag": "edf93b48-fcc1-4e49-8e39-c1b15f505afa"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:51.130212 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:37:51.130212 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:37:51.140683 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f7613fec-079a-41b0-9c10-ef9d4006a4a9 req-82583964-3ebc-4aa9-bc66-bd904904f841 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:51.141417 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-f7613fec-079a-41b0-9c10-ef9d4006a4a9 req-82583964-3ebc-4aa9-bc66-bd904904f841 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:51.160400 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-f7613fec-079a-41b0-9c10-ef9d4006a4a9 req-82583964-3ebc-4aa9-bc66-bd904904f841 service nova] Creating event network-vif-unplugged:edf93b48-fcc1-4e49-8e39-c1b15f505afa for instance 91810efd-26bb-4c78-9a55-dbd3949de8c3 on hv-cinder-75996 Feb 17 03:37:51.165881 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-f7613fec-079a-41b0-9c10-ef9d4006a4a9 req-82583964-3ebc-4aa9-bc66-bd904904f841 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042715 Feb 17 03:37:51.166798 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 625/1199] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:37:51 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:37:51.612254 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e6ab7f98-ee86-4bad-95cc-4c275ffc1058 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:51.613375 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e6ab7f98-ee86-4bad-95cc-4c275ffc1058 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:51.621448 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e6ab7f98-ee86-4bad-95cc-4c275ffc1058 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:51.621912 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e6ab7f98-ee86-4bad-95cc-4c275ffc1058 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:51.622749 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e6ab7f98-ee86-4bad-95cc-4c275ffc1058 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:51.623231 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e6ab7f98-ee86-4bad-95cc-4c275ffc1058 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:51.833079 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-9f3b5592-997e-4add-92e3-79bce2d6e1e7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Updating instance_info_cache with network_info: [{"id": "a464a31e-93f8-4268-9196-2112eb20fd88", "address": "fa:16:3e:0e:2a:6c", "network": {"id": "4e746511-e0b4-40cf-9f26-4fcf068fda47", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-563910191-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fce55aed27e14d6791193d35e5ac2137", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapa464a31e-93", "ovs_interfaceid": "a464a31e-93f8-4268-9196-2112eb20fd88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:37:51.841875 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9f3b5592-997e-4add-92e3-79bce2d6e1e7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Releasing lock "refresh_cache-0207f5fc-d1d8-495e-abed-39b09228824c" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:37:51.842770 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9f3b5592-997e-4add-92e3-79bce2d6e1e7 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "POST /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c/action" status: 202 len: 0 microversion: 2.1 time: 3.794546 Feb 17 03:37:51.843636 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 575/1200] 10.222.0.46 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:48 2021] POST /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c/action => generated 0 bytes in 3796 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 03:37:51.912722 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-e6ab7f98-ee86-4bad-95cc-4c275ffc1058 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:51.921589 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e6ab7f98-ee86-4bad-95cc-4c275ffc1058 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1556 microversion: 2.1 time: 0.315494 Feb 17 03:37:51.922193 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 626/1201] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:51 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1556 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:37:52.940580 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-46a677e3-faa9-4269-9193-879076aeca92 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:52.941350 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-46a677e3-faa9-4269-9193-879076aeca92 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:52.949213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46a677e3-faa9-4269-9193-879076aeca92 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:52.949714 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46a677e3-faa9-4269-9193-879076aeca92 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:52.950543 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46a677e3-faa9-4269-9193-879076aeca92 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:52.951035 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46a677e3-faa9-4269-9193-879076aeca92 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:53.339764 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-46a677e3-faa9-4269-9193-879076aeca92 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290a415c3af6474abe44da4a09305695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452d5eab351441619d3b9376e7e200d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:53.349119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-46a677e3-faa9-4269-9193-879076aeca92 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 200 len: 1514 microversion: 2.1 time: 0.412620 Feb 17 03:37:53.349718 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 576/1202] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:52 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 1514 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:53.421535 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-4066cb13-5a23-485a-a460-c7b560976f21 req-0eaf19c3-6802-4da0-aa2a-e79f89e22f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91810efd-26bb-4c78-9a55-dbd3949de8c3", "name": "network-vif-deleted", "tag": "edf93b48-fcc1-4e49-8e39-c1b15f505afa"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:53.423171 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:37:53.423171 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:37:53.432374 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-4066cb13-5a23-485a-a460-c7b560976f21 req-0eaf19c3-6802-4da0-aa2a-e79f89e22f05 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:53.432872 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-4066cb13-5a23-485a-a460-c7b560976f21 req-0eaf19c3-6802-4da0-aa2a-e79f89e22f05 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:53.456537 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-4066cb13-5a23-485a-a460-c7b560976f21 req-0eaf19c3-6802-4da0-aa2a-e79f89e22f05 service nova] Creating event network-vif-deleted:edf93b48-fcc1-4e49-8e39-c1b15f505afa for instance 91810efd-26bb-4c78-9a55-dbd3949de8c3 on hv-cinder-75996 Feb 17 03:37:53.461640 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-4066cb13-5a23-485a-a460-c7b560976f21 req-0eaf19c3-6802-4da0-aa2a-e79f89e22f05 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043860 Feb 17 03:37:53.462302 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 627/1203] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:37:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:37:54.368204 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-364b35eb-43b6-430f-afa2-5fdc27e382f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:54.368869 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-364b35eb-43b6-430f-afa2-5fdc27e382f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] [instance: 91810efd-26bb-4c78-9a55-dbd3949de8c3] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:54.377336 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-364b35eb-43b6-430f-afa2-5fdc27e382f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:54.377843 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-364b35eb-43b6-430f-afa2-5fdc27e382f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:54.378669 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-364b35eb-43b6-430f-afa2-5fdc27e382f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:54.379177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-364b35eb-43b6-430f-afa2-5fdc27e382f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:54.430680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-364b35eb-43b6-430f-afa2-5fdc27e382f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] HTTP exception thrown: Instance 91810efd-26bb-4c78-9a55-dbd3949de8c3 could not be found. Feb 17 03:37:54.431331 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-364b35eb-43b6-430f-afa2-5fdc27e382f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Returning 404 to user: Instance 91810efd-26bb-4c78-9a55-dbd3949de8c3 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:37:54.432239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-364b35eb-43b6-430f-afa2-5fdc27e382f8 tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3" status: 404 len: 111 microversion: 2.1 time: 0.068125 Feb 17 03:37:54.432825 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 577/1204] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:54 2021] GET /compute/v2.1/servers/91810efd-26bb-4c78-9a55-dbd3949de8c3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:37:54.442763 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-43cc461c-9b15-4017-8a45-55ac242482ee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] Calling method '.version_select at 0x7f012e359950>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:54.458846 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-43cc461c-9b15-4017-8a45-55ac242482ee tempest-TestMinimumBasicScenario-137870181 tempest-TestMinimumBasicScenario-137870181-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1512308989" status: 202 len: 0 microversion: 2.1 time: 0.020539 Feb 17 03:37:54.459423 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 628/1205] 10.222.0.46 () {58 vars in 1262 bytes} [Wed Feb 17 03:37:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1512308989 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:39:12.809679 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f465ca0b-8ce2-4d55-ad78-d7717eabbb2b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '.version_select at 0x7f0133069ea0>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:13.340739 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f465ca0b-8ce2-4d55-ad78-d7717eabbb2b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:13.348917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f465ca0b-8ce2-4d55-ad78-d7717eabbb2b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:13.349422 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f465ca0b-8ce2-4d55-ad78-d7717eabbb2b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:13.350267 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f465ca0b-8ce2-4d55-ad78-d7717eabbb2b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:13.350757 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f465ca0b-8ce2-4d55-ad78-d7717eabbb2b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:13.418495 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f465ca0b-8ce2-4d55-ad78-d7717eabbb2b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Acquired lock "refresh_cache-0207f5fc-d1d8-495e-abed-39b09228824c" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:39:15.440361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-f465ca0b-8ce2-4d55-ad78-d7717eabbb2b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Building network info cache for instance {{(pid=98184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:39:15.451140 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-971d9b51-ff90-452f-9b6b-265da9a5348e req-02a777b4-4630-4f42-85c7-e58049a3f1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0207f5fc-d1d8-495e-abed-39b09228824c", "tag": "a464a31e-93f8-4268-9196-2112eb20fd88"}]} {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:15.452802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:15.452802 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:39:15.463139 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-971d9b51-ff90-452f-9b6b-265da9a5348e req-02a777b4-4630-4f42-85c7-e58049a3f1f0 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:15.463668 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-971d9b51-ff90-452f-9b6b-265da9a5348e req-02a777b4-4630-4f42-85c7-e58049a3f1f0 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:15.488277 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-971d9b51-ff90-452f-9b6b-265da9a5348e req-02a777b4-4630-4f42-85c7-e58049a3f1f0 service nova] Creating event network-changed:a464a31e-93f8-4268-9196-2112eb20fd88 for instance 0207f5fc-d1d8-495e-abed-39b09228824c on hv-cinder-75996 Feb 17 03:39:15.493755 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-971d9b51-ff90-452f-9b6b-265da9a5348e req-02a777b4-4630-4f42-85c7-e58049a3f1f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047716 Feb 17 03:39:15.494707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 629/1206] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:39:17.124075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-f465ca0b-8ce2-4d55-ad78-d7717eabbb2b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Updating instance_info_cache with network_info: [{"id": "a464a31e-93f8-4268-9196-2112eb20fd88", "address": "fa:16:3e:0e:2a:6c", "network": {"id": "4e746511-e0b4-40cf-9f26-4fcf068fda47", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-563910191-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fce55aed27e14d6791193d35e5ac2137", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapa464a31e-93", "ovs_interfaceid": "a464a31e-93f8-4268-9196-2112eb20fd88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:39:17.137988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f465ca0b-8ce2-4d55-ad78-d7717eabbb2b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Releasing lock "refresh_cache-0207f5fc-d1d8-495e-abed-39b09228824c" {{(pid=98184) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:39:17.139475 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f465ca0b-8ce2-4d55-ad78-d7717eabbb2b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/cc142d57-5e09-497d-a448-8fc915f97d0e" status: 202 len: 0 microversion: 2.1 time: 4.334240 Feb 17 03:39:17.140845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 578/1207] 10.222.0.46 () {58 vars in 1253 bytes} [Wed Feb 17 03:39:12 2021] DELETE /compute/v2.1/os-floating-ips/cc142d57-5e09-497d-a448-8fc915f97d0e => generated 0 bytes in 4336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:39:17.150101 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-bc19fc84-6121-4bbb-a999-47bd01e09154 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:17.150845 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bc19fc84-6121-4bbb-a999-47bd01e09154 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:17.159332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc19fc84-6121-4bbb-a999-47bd01e09154 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:17.159988 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc19fc84-6121-4bbb-a999-47bd01e09154 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:17.160911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc19fc84-6121-4bbb-a999-47bd01e09154 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:17.161394 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-bc19fc84-6121-4bbb-a999-47bd01e09154 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:17.248004 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-bc19fc84-6121-4bbb-a999-47bd01e09154 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Going to try to terminate instance {{(pid=98183) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:39:17.369384 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-bc19fc84-6121-4bbb-a999-47bd01e09154 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 204 len: 0 microversion: 2.1 time: 0.223563 Feb 17 03:39:17.371177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 630/1208] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:39:17 2021] DELETE /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:39:17.381427 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-db507c42-d23e-4170-b019-b252ea26ab9f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:17.381546 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-db507c42-d23e-4170-b019-b252ea26ab9f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:17.392991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db507c42-d23e-4170-b019-b252ea26ab9f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:17.393494 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db507c42-d23e-4170-b019-b252ea26ab9f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:17.394340 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db507c42-d23e-4170-b019-b252ea26ab9f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:17.394829 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-db507c42-d23e-4170-b019-b252ea26ab9f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:17.633745 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-db507c42-d23e-4170-b019-b252ea26ab9f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:17.645847 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-db507c42-d23e-4170-b019-b252ea26ab9f tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1466 microversion: 2.1 time: 0.268993 Feb 17 03:39:17.646434 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 579/1209] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:17 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1466 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:18.665994 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-10dba655-2719-400a-829f-3ebaccd188d4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:18.666762 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-10dba655-2719-400a-829f-3ebaccd188d4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:18.674575 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-10dba655-2719-400a-829f-3ebaccd188d4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:18.675066 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-10dba655-2719-400a-829f-3ebaccd188d4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:18.675911 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-10dba655-2719-400a-829f-3ebaccd188d4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:18.676396 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-10dba655-2719-400a-829f-3ebaccd188d4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:18.906007 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-10dba655-2719-400a-829f-3ebaccd188d4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:18.915010 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-10dba655-2719-400a-829f-3ebaccd188d4 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1466 microversion: 2.1 time: 0.253679 Feb 17 03:39:18.915624 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 631/1210] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:18 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1466 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:19.861627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-e52c4f68-2b88-4cd8-9978-8f2bf783c0d3 req-d3b19196-5662-4482-9f24-a2f1db108ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0207f5fc-d1d8-495e-abed-39b09228824c", "name": "network-vif-unplugged", "status": "completed", "tag": "a464a31e-93f8-4268-9196-2112eb20fd88"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:19.863409 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:19.863409 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:39:19.874688 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-e52c4f68-2b88-4cd8-9978-8f2bf783c0d3 req-d3b19196-5662-4482-9f24-a2f1db108ea1 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:19.875213 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-e52c4f68-2b88-4cd8-9978-8f2bf783c0d3 req-d3b19196-5662-4482-9f24-a2f1db108ea1 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:19.896243 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-e52c4f68-2b88-4cd8-9978-8f2bf783c0d3 req-d3b19196-5662-4482-9f24-a2f1db108ea1 service nova] Creating event network-vif-unplugged:a464a31e-93f8-4268-9196-2112eb20fd88 for instance 0207f5fc-d1d8-495e-abed-39b09228824c on hv-cinder-75996 Feb 17 03:39:19.901568 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-e52c4f68-2b88-4cd8-9978-8f2bf783c0d3 req-d3b19196-5662-4482-9f24-a2f1db108ea1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044092 Feb 17 03:39:19.902232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 580/1211] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:19 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:39:19.933991 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1bc4e813-9ce3-4d6f-b4d8-f678a412c45b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:19.934653 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1bc4e813-9ce3-4d6f-b4d8-f678a412c45b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:19.942625 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bc4e813-9ce3-4d6f-b4d8-f678a412c45b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:19.943119 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bc4e813-9ce3-4d6f-b4d8-f678a412c45b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:19.943973 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bc4e813-9ce3-4d6f-b4d8-f678a412c45b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:19.944456 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1bc4e813-9ce3-4d6f-b4d8-f678a412c45b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:20.159902 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1bc4e813-9ce3-4d6f-b4d8-f678a412c45b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:20.169317 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1bc4e813-9ce3-4d6f-b4d8-f678a412c45b tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1466 microversion: 2.1 time: 0.239869 Feb 17 03:39:20.169922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 632/1212] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:19 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1466 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:21.177395 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-fe17ae2e-3509-4704-bff3-86e4ce9b493a req-70422cd1-94e8-41ad-8caf-0e21fccb67a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0207f5fc-d1d8-495e-abed-39b09228824c", "name": "network-vif-deleted", "tag": "a464a31e-93f8-4268-9196-2112eb20fd88"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:21.179450 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:21.179450 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:39:21.188742 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-1a495591-8b37-4928-8a11-11c8dc66b929 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:21.189401 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-1a495591-8b37-4928-8a11-11c8dc66b929 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:21.190217 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-fe17ae2e-3509-4704-bff3-86e4ce9b493a req-70422cd1-94e8-41ad-8caf-0e21fccb67a7 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:21.190720 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-fe17ae2e-3509-4704-bff3-86e4ce9b493a req-70422cd1-94e8-41ad-8caf-0e21fccb67a7 service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:21.197496 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a495591-8b37-4928-8a11-11c8dc66b929 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:21.198858 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a495591-8b37-4928-8a11-11c8dc66b929 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:21.199759 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a495591-8b37-4928-8a11-11c8dc66b929 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:21.200252 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-1a495591-8b37-4928-8a11-11c8dc66b929 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:21.212022 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-fe17ae2e-3509-4704-bff3-86e4ce9b493a req-70422cd1-94e8-41ad-8caf-0e21fccb67a7 service nova] Creating event network-vif-deleted:a464a31e-93f8-4268-9196-2112eb20fd88 for instance 0207f5fc-d1d8-495e-abed-39b09228824c on hv-cinder-75996 Feb 17 03:39:21.219054 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-fe17ae2e-3509-4704-bff3-86e4ce9b493a req-70422cd1-94e8-41ad-8caf-0e21fccb67a7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046161 Feb 17 03:39:21.220279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 581/1213] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:39:21.355259 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-1a495591-8b37-4928-8a11-11c8dc66b929 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:21.375747 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-1a495591-8b37-4928-8a11-11c8dc66b929 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 200 len: 1225 microversion: 2.1 time: 0.191129 Feb 17 03:39:21.376368 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 633/1214] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:21 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 1225 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:22.395177 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8871b43d-aed8-48a5-8e14-8e8fc4bcaab1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:22.395949 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-8871b43d-aed8-48a5-8e14-8e8fc4bcaab1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 0207f5fc-d1d8-495e-abed-39b09228824c] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:22.404269 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8871b43d-aed8-48a5-8e14-8e8fc4bcaab1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:22.404771 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8871b43d-aed8-48a5-8e14-8e8fc4bcaab1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:22.405601 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8871b43d-aed8-48a5-8e14-8e8fc4bcaab1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:22.406085 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-8871b43d-aed8-48a5-8e14-8e8fc4bcaab1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:22.459958 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-8871b43d-aed8-48a5-8e14-8e8fc4bcaab1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] HTTP exception thrown: Instance 0207f5fc-d1d8-495e-abed-39b09228824c could not be found. Feb 17 03:39:22.460620 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-8871b43d-aed8-48a5-8e14-8e8fc4bcaab1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Returning 404 to user: Instance 0207f5fc-d1d8-495e-abed-39b09228824c could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:39:22.461513 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-8871b43d-aed8-48a5-8e14-8e8fc4bcaab1 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c" status: 404 len: 111 microversion: 2.1 time: 0.070856 Feb 17 03:39:22.462133 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 582/1215] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:22 2021] GET /compute/v2.1/servers/0207f5fc-d1d8-495e-abed-39b09228824c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:39:24.887724 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-82fbe83e-20c8-4fd6-a6a1-972ca2dc5af3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '.version_select at 0x7f012e4c6f28>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:25.403696 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-82fbe83e-20c8-4fd6-a6a1-972ca2dc5af3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:25.412388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82fbe83e-20c8-4fd6-a6a1-972ca2dc5af3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:25.412897 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82fbe83e-20c8-4fd6-a6a1-972ca2dc5af3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:25.413745 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82fbe83e-20c8-4fd6-a6a1-972ca2dc5af3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:25.414239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82fbe83e-20c8-4fd6-a6a1-972ca2dc5af3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:25.478936 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82fbe83e-20c8-4fd6-a6a1-972ca2dc5af3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Acquired lock "refresh_cache-fee716fa-64a8-4f42-9f18-bf27ec384b48" {{(pid=98183) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:39:27.460493 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-82fbe83e-20c8-4fd6-a6a1-972ca2dc5af3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Building network info cache for instance {{(pid=98183) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:39:27.470016 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-8337cb4d-90dd-4314-92f7-66f147720e4c req-fcd0b637-d959-41b2-a6ea-f8c0687009cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee716fa-64a8-4f42-9f18-bf27ec384b48", "tag": "65586199-8d17-4dc4-95e3-587c045d051c"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:27.471698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:27.471698 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:39:27.480611 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-8337cb4d-90dd-4314-92f7-66f147720e4c req-fcd0b637-d959-41b2-a6ea-f8c0687009cf service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:27.481093 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-8337cb4d-90dd-4314-92f7-66f147720e4c req-fcd0b637-d959-41b2-a6ea-f8c0687009cf service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:27.502509 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-8337cb4d-90dd-4314-92f7-66f147720e4c req-fcd0b637-d959-41b2-a6ea-f8c0687009cf service nova] Creating event network-changed:65586199-8d17-4dc4-95e3-587c045d051c for instance fee716fa-64a8-4f42-9f18-bf27ec384b48 on hv-cinder-75996 Feb 17 03:39:27.508029 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-8337cb4d-90dd-4314-92f7-66f147720e4c req-fcd0b637-d959-41b2-a6ea-f8c0687009cf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041813 Feb 17 03:39:27.508680 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 583/1216] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:39:29.293365 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.network.neutron [None req-82fbe83e-20c8-4fd6-a6a1-972ca2dc5af3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Updating instance_info_cache with network_info: [{"id": "65586199-8d17-4dc4-95e3-587c045d051c", "address": "fa:16:3e:a0:05:85", "network": {"id": "4e746511-e0b4-40cf-9f26-4fcf068fda47", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-563910191-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fce55aed27e14d6791193d35e5ac2137", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap65586199-8d", "ovs_interfaceid": "65586199-8d17-4dc4-95e3-587c045d051c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98183) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:39:29.302075 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-82fbe83e-20c8-4fd6-a6a1-972ca2dc5af3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Releasing lock "refresh_cache-fee716fa-64a8-4f42-9f18-bf27ec384b48" {{(pid=98183) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:39:29.303024 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-82fbe83e-20c8-4fd6-a6a1-972ca2dc5af3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/555a9b2f-9758-498a-ad16-279b21385ddd" status: 202 len: 0 microversion: 2.1 time: 4.419292 Feb 17 03:39:29.303703 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 634/1217] 10.222.0.46 () {58 vars in 1253 bytes} [Wed Feb 17 03:39:24 2021] DELETE /compute/v2.1/os-floating-ips/555a9b2f-9758-498a-ad16-279b21385ddd => generated 0 bytes in 4421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:39:29.313332 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-5f7b6dce-da8b-494c-9eeb-d2387ddfc08c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:29.313974 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5f7b6dce-da8b-494c-9eeb-d2387ddfc08c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:29.322443 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5f7b6dce-da8b-494c-9eeb-d2387ddfc08c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:29.323745 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5f7b6dce-da8b-494c-9eeb-d2387ddfc08c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:29.324597 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5f7b6dce-da8b-494c-9eeb-d2387ddfc08c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:29.325084 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-5f7b6dce-da8b-494c-9eeb-d2387ddfc08c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:29.390416 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-5f7b6dce-da8b-494c-9eeb-d2387ddfc08c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Going to try to terminate instance {{(pid=98184) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:39:29.511205 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-5f7b6dce-da8b-494c-9eeb-d2387ddfc08c tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 204 len: 0 microversion: 2.1 time: 0.201436 Feb 17 03:39:29.511904 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 584/1218] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:39:29 2021] DELETE /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:39:29.520503 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-9a38f513-a0dc-4c06-a66a-aa033558ae15 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:29.521162 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-9a38f513-a0dc-4c06-a66a-aa033558ae15 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:29.529705 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a38f513-a0dc-4c06-a66a-aa033558ae15 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:29.530197 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a38f513-a0dc-4c06-a66a-aa033558ae15 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:29.531019 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a38f513-a0dc-4c06-a66a-aa033558ae15 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:29.531498 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-9a38f513-a0dc-4c06-a66a-aa033558ae15 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:29.768987 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-9a38f513-a0dc-4c06-a66a-aa033558ae15 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:29.777940 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-9a38f513-a0dc-4c06-a66a-aa033558ae15 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1466 microversion: 2.1 time: 0.261471 Feb 17 03:39:29.778537 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 635/1219] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:29 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1466 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:30.797226 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-a36404a0-0fae-4fbe-a351-95a199527ae2 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:30.797986 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-a36404a0-0fae-4fbe-a351-95a199527ae2 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:30.805800 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a36404a0-0fae-4fbe-a351-95a199527ae2 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:30.806301 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a36404a0-0fae-4fbe-a351-95a199527ae2 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:30.807121 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a36404a0-0fae-4fbe-a351-95a199527ae2 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:30.807631 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-a36404a0-0fae-4fbe-a351-95a199527ae2 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:31.014719 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-a36404a0-0fae-4fbe-a351-95a199527ae2 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98184) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:31.023473 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-a36404a0-0fae-4fbe-a351-95a199527ae2 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1466 microversion: 2.1 time: 0.230826 Feb 17 03:39:31.024116 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 585/1220] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:30 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1466 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:32.043337 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-46a7a01b-4e7d-4564-b426-fbfbb02c14a0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:32.044041 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-46a7a01b-4e7d-4564-b426-fbfbb02c14a0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:32.052214 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46a7a01b-4e7d-4564-b426-fbfbb02c14a0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:32.052716 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46a7a01b-4e7d-4564-b426-fbfbb02c14a0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:32.053555 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46a7a01b-4e7d-4564-b426-fbfbb02c14a0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:32.054043 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-46a7a01b-4e7d-4564-b426-fbfbb02c14a0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:32.189539 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.policy [None req-46a7a01b-4e7d-4564-b426-fbfbb02c14a0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a08274bcef1c4e73a39e60b3a11b09d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce55aed27e14d6791193d35e5ac2137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98183) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:32.198980 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-46a7a01b-4e7d-4564-b426-fbfbb02c14a0 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 200 len: 1391 microversion: 2.1 time: 0.160445 Feb 17 03:39:32.199612 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 636/1221] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:32 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:32.251101 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [req-5c70a2e6-63a5-4971-9fb9-db3d6a9742ab req-a9db2ed1-697b-464f-a687-79684c0ad98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee716fa-64a8-4f42-9f18-bf27ec384b48", "name": "network-vif-deleted", "tag": "65586199-8d17-4dc4-95e3-587c045d051c"}]} {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:32.253109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:32.253109 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: warnings.warn(msg) Feb 17 03:39:32.263272 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-5c70a2e6-63a5-4971-9fb9-db3d6a9742ab req-a9db2ed1-697b-464f-a687-79684c0ad98c service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:32.263884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [req-5c70a2e6-63a5-4971-9fb9-db3d6a9742ab req-a9db2ed1-697b-464f-a687-79684c0ad98c service nova] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:32.287851 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.compute.server_external_events [req-5c70a2e6-63a5-4971-9fb9-db3d6a9742ab req-a9db2ed1-697b-464f-a687-79684c0ad98c service nova] Creating event network-vif-deleted:65586199-8d17-4dc4-95e3-587c045d051c for instance fee716fa-64a8-4f42-9f18-bf27ec384b48 on hv-cinder-75996 Feb 17 03:39:32.294279 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [req-5c70a2e6-63a5-4971-9fb9-db3d6a9742ab req-a9db2ed1-697b-464f-a687-79684c0ad98c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047468 Feb 17 03:39:32.295012 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 586/1222] 10.222.0.46 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:39:33.217960 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e8952887-d2b5-4c9d-aee5-ae4fd385acee tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:33.218736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e8952887-d2b5-4c9d-aee5-ae4fd385acee tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: fee716fa-64a8-4f42-9f18-bf27ec384b48] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:33.235360 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e8952887-d2b5-4c9d-aee5-ae4fd385acee tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:33.235890 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e8952887-d2b5-4c9d-aee5-ae4fd385acee tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:33.236736 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e8952887-d2b5-4c9d-aee5-ae4fd385acee tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:33.237223 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e8952887-d2b5-4c9d-aee5-ae4fd385acee tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:33.298558 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-e8952887-d2b5-4c9d-aee5-ae4fd385acee tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] HTTP exception thrown: Instance fee716fa-64a8-4f42-9f18-bf27ec384b48 could not be found. Feb 17 03:39:33.299239 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e8952887-d2b5-4c9d-aee5-ae4fd385acee tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Returning 404 to user: Instance fee716fa-64a8-4f42-9f18-bf27ec384b48 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:39:33.300184 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e8952887-d2b5-4c9d-aee5-ae4fd385acee tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48" status: 404 len: 111 microversion: 2.1 time: 0.086731 Feb 17 03:39:33.300821 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 637/1223] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:33 2021] GET /compute/v2.1/servers/fee716fa-64a8-4f42-9f18-bf27ec384b48 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:39:33.310871 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-fa52f8af-4ef3-4baf-b2dc-48ac43da26ed tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '.version_select at 0x7f0133069bf8>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:34.693046 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-fa52f8af-4ef3-4baf-b2dc-48ac43da26ed tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/7b3aa4bb-a9c2-4f93-9b5d-2c963469362f" status: 202 len: 0 microversion: 2.1 time: 1.387038 Feb 17 03:39:34.693737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 587/1224] 10.222.0.46 () {58 vars in 1253 bytes} [Wed Feb 17 03:39:33 2021] DELETE /compute/v2.1/os-floating-ips/7b3aa4bb-a9c2-4f93-9b5d-2c963469362f => generated 0 bytes in 1389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:39:34.702541 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e8073935-19f0-4299-8197-05658617e70a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:34.703098 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-e8073935-19f0-4299-8197-05658617e70a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98183) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:34.711388 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e8073935-19f0-4299-8197-05658617e70a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:34.711948 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e8073935-19f0-4299-8197-05658617e70a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:34.712801 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e8073935-19f0-4299-8197-05658617e70a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:34.713348 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-e8073935-19f0-4299-8197-05658617e70a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98183) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:34.768627 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-e8073935-19f0-4299-8197-05658617e70a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] HTTP exception thrown: Instance 09664edd-5f9f-4b5e-b7b1-06857eff4d59 could not be found. Feb 17 03:39:34.769293 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-e8073935-19f0-4299-8197-05658617e70a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Returning 404 to user: Instance 09664edd-5f9f-4b5e-b7b1-06857eff4d59 could not be found. {{(pid=98183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:39:34.770195 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-e8073935-19f0-4299-8197-05658617e70a tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "DELETE /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 404 len: 111 microversion: 2.1 time: 0.071726 Feb 17 03:39:34.770823 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 638/1225] 10.222.0.46 () {58 vars in 1229 bytes} [Wed Feb 17 03:39:34 2021] DELETE /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:39:34.780361 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f941cf97-b8b3-408b-9a96-9572393f6800 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:34.781155 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.compute.api [None req-f941cf97-b8b3-408b-9a96-9572393f6800 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] [instance: 09664edd-5f9f-4b5e-b7b1-06857eff4d59] Fetching instance by UUID {{(pid=98184) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:34.789370 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f941cf97-b8b3-408b-9a96-9572393f6800 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:34.789877 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f941cf97-b8b3-408b-9a96-9572393f6800 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:34.790717 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f941cf97-b8b3-408b-9a96-9572393f6800 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:34.791203 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG oslo_concurrency.lockutils [None req-f941cf97-b8b3-408b-9a96-9572393f6800 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Lock "1b064fdc-543f-4d05-b0d7-96b33fa238fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98184) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:34.846206 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.wsgi [None req-f941cf97-b8b3-408b-9a96-9572393f6800 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] HTTP exception thrown: Instance 09664edd-5f9f-4b5e-b7b1-06857eff4d59 could not be found. Feb 17 03:39:34.846792 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f941cf97-b8b3-408b-9a96-9572393f6800 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Returning 404 to user: Instance 09664edd-5f9f-4b5e-b7b1-06857eff4d59 could not be found. {{(pid=98184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:39:34.847737 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f941cf97-b8b3-408b-9a96-9572393f6800 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59" status: 404 len: 111 microversion: 2.1 time: 0.071964 Feb 17 03:39:34.848367 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 588/1226] 10.222.0.46 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:34 2021] GET /compute/v2.1/servers/09664edd-5f9f-4b5e-b7b1-06857eff4d59 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:39:36.106922 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-f7cd9e89-8264-4c58-9804-9e636bbfa982 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '.version_select at 0x7f012e50c598>' {{(pid=98183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:36.364011 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-f7cd9e89-8264-4c58-9804-9e636bbfa982 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/1cd712cf-7c9f-4ad9-9741-bb196d1f45dd" status: 202 len: 0 microversion: 2.1 time: 0.262073 Feb 17 03:39:36.364622 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98183|app: 0|req: 639/1227] 10.222.0.46 () {58 vars in 1262 bytes} [Wed Feb 17 03:39:36 2021] DELETE /compute/v2.1/os-security-groups/1cd712cf-7c9f-4ad9-9741-bb196d1f45dd => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:39:36.373261 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: DEBUG nova.api.openstack.wsgi [None req-6e33362a-c1c4-4cc4-b8e7-b1e8310e7eb3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] Calling method '.version_select at 0x7f012e7a5bf8>' {{(pid=98184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:36.392523 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO nova.api.openstack.requestlog [None req-6e33362a-c1c4-4cc4-b8e7-b1e8310e7eb3 tempest-TestVolumeBootPattern-1663192546 tempest-TestVolumeBootPattern-1663192546-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1857685246" status: 202 len: 0 microversion: 2.1 time: 0.023194 Feb 17 03:39:36.393169 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: [pid: 98184|app: 0|req: 589/1228] 10.222.0.46 () {58 vars in 1253 bytes} [Wed Feb 17 03:39:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1857685246 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:40:13.573117 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:40:13.573707 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:40:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:40:47.136531 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:40:47.137145 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:40:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:41:22.710404 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:41:22.711000 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:41:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:41:48.520961 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:41:48.521468 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:41:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:41:54.736026 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:41:54.736536 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:41:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:43:33.591337 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:43:33.591916 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:43:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:44:07.155232 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:44:07.155884 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:44:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:44:42.727917 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:44:42.728508 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:44:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:45:05.207180 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:45:05.207800 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:45:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:45:08.537891 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:45:08.538359 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:45:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:45:14.753068 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:45:14.753626 dv-cinder-759961-4-iscsi devstack@n-api.service[98182]: Wed Feb 17 03:45:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!